These are the ros drivers for running the Pt Grey (FLIR) cameras that use the Spinnaker SDK. This code has been tested with various Point Grey Blackfly S (BFS) cameras.
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.
The pre-requisites for this repo include:
- ros-kinetic-desktop-full
- spinnaker (download from Pt Grey's website)
- ros-kinetic-cv-bridge
- ros-kinetic-image-transport
- libunwind-dev
# after installing spinnaker verify that you can run your cameras with SpinView
# after installing ros, install other pre-requisites with:
sudo apt install libunwind-dev ros-kinetic-cv-bridge ros-kinetic-image-transport
# if you use arm64 (aarch64), install pre-requisites with:
sudo apt install ros-kinetic-cv-bridge ros-kinetic-image-transport
To install the spinnaker drivers
mkdir -p ~/spinnaker_ws/src
cd spinnaker_ws/src
git clone https://github.com/neufieldrobotics/spinnaker_camera_driver.git
cd ~/spinnaker_ws/
catkin_make
source ~/spinnaker_ws/devel/setup.bash
# add this to ~/.bashrc to make this permanent Modify the params/test_params.yaml file replacing the cam-ids and master cam serial number to match your camera's serial number. Then run the code as:
# To launch nodelet verison of driver, use #
roslaunch spinnaker_camera_driver acquisition_nodelet.launch
# To launch node version of driver, use
roslaunch spinnaker_camera_driver acquisition.launch
# Test that the images are being published by running
rqt_image_viewAll the parameters can be set via the launch file or via the yaml config_file. It is good practice to specify all the 'task' specific parameters via launch file and all the 'system configuration' specific parameters via a config_file.
- ~binning (int, default: 1)
Binning for cameras, when changing from 2 to 1 cameras need to be unplugged and replugged - ~color (bool, default: false)
Should color images be used (only works on models that support color images) - ~exposure_time (int, default: 0, 0:auto)
Exposure setting for cameras, also available as dynamic reconfiguarble parameter. - ~target_grey_value (double, default: 0 , 0:Continous/auto) Setting target_grey_value > 4 (min:4 , max:99) will turn AutoExposureTargetGreyValueAuto to 'off' and set AutoExposureTargetGreyValue to target_grey_value. Also available as dynamic reconfigurable parameter. see below in Dynamic reconfigurable parameter section.
- ~frames (int, default: 50)
Number of frames to save/view 0=ON - ~live (bool, default: false)
Show images on screen GUI - ~live_grid (bool, default: false)
Show images on screen GUI in a grid - ~save (bool, default: false)
Flag whether images should be saved or not (via opencv mat objects to disk) - ~save_path (string, default: "~/projects/data")
Location to save the image data - ~save_type (string, default: "bmp")
Type of file type to save to when saving images locally: binary, tiff, bmp, jpeg etc. - ~soft_framerate (int, default: 20)
When hybrid software triggering is used, this controls the FPS, 0=as fast as possible - ~time (bool, default=false)
Show time/FPS on output - ~to_ros (bool, default: true)
Flag whether images should be published to ROS. When manually selecting frames to send to rosbag, set this to False. In that case, frames will only be sent when 'space bar' is pressed - ~utstamps (bool, default:false)
Flag whether each image should have Unique timestamps vs the master cams time stamp for all - ~max_rate_save (bool, default: false)
Flag for max rate mode which is when the master triggers the slaves and saves images at maximum rate possible. This is the multithreaded mode
- ~cam_ids (yaml sequence or array)
This is a list of camera serial numbers in the order which it would be organized. The convention is to start from left to right. - ~cam_aliases (yaml squence or array)
This is the names that would be given to the cameras for filenames and rostopics in the order specified above eg. cam0, cam1 etc. - ~master_cam (int, default: )
This is the serial number of the camera to be used as master for triggering the other cameras. - ~skip (int)
Number of frames to be skipped initially to flush the buffer - ~delay (float)
Secs to wait in the deinit/init sequence.
-
~target_grey_value (double) Target Grey Value is a parameter that helps to compensate for various lighting conditions by adjusting brightness to achieve optimal imaging results. The value is linear and is a percentage of the maximum pixel value. Explained in detail at FLIR webpage.
Setting target_grey_value invokes setting AutoExposureTargetGreyValueAuto to 'off' and AutoExposureTargetGreyValue is set to target_grey_value.
-
~exposure_time (int, default= 0, 0:auto) Exposure time for the sensor. When Exposure time is set within minimum and maximum exposure time limits(varies with camera model), ExposureAuto is set to 'off' and ExposureTime is set to exposure_time param value.
When exposure_time is set to 0(zero), the ExposureAuto is set to 'Continuous', enabling auto exposure.
- ~nodelet_manager_name (string, default: vision_nodelet_manager) Specify the name of the nodelet_manager under which nodelet to be launched.
- ~start_nodelet_manager (bool, default: false)
If set True, nodelet_manager of name
$(arg nodelet_manager_name) will be launched. If set False(default), the acquisition/capture_nodelet waits for the nodelet_manager name $ (arg nodelet_manager_name).
- ~image_width (int)
- ~image_height (int)
- ~distortion_model (string)
Distortion model for the camera calibration. Typical is 'plumb_bob' - ~distortion_coeffs (array of arrays)
Distortion coefficients of all the cameras in the array. Must match the number of cam_ids provided. - ~intrinsic_coeff (array of arrays)
Intrinsic coefficients of all the cameras in the array. Must match the number of cam_ids provided. Specified as [fx 0 cx 0 fy cy 0 0 1] - ~projection_coeffs (array of arrays)
Projection coefficients of all the cameras in the array. Must match the number of cam_ids provided. For case of Monocular camera, if projection_coeffs is not set, intrinsic_coeff will be used to set, P[1:3,1:3]=K - ~rectification_coeffs (array of arrays)
Rectification coefficients of all the cameras in the array. Must match the number of cam_ids provided.
When using multiple cameras, we have found that the only way to keep images between different cameras synched is by using a master-slave setup using the GPIO connector. So this is the only way we support multicamera operation with this code. A general guide for multi camera setup is available at https://www.ptgrey.com/tan/11052, however note that we use a slightly different setup with our package.
Refer to the params/multi-cam_example.yaml for an example on how to setup the configuration. You must specify a master_cam which must be one of the cameras in the cam_ids list. This master camera is the camera that is either explicitly software triggered by the code or triggered internally via a counter at a given frame rate. All the other cameras are triggered externally when the master camera triggers. In order to make this work, the wiring must be such that the external signal from the master camera Line2 is connected to Line3 on all slave cameras. To connect cameras in this way:
- Connect the primary (master) camera's pin 3 (red wire, GPIO) to each secondary (slave) camera's pin 1 (green wire, GPI).
- Connect the primary (master) camera's pin 5 (blue wire, opto ground) and pin 6 (brown wire, ground) to each secondary (slave) camera's pin 6 (brown wire, ground).
GPIO Pinouts for Blackfly S
GPIO Connections for Master/Slave config
This project is licensed under the MIT License - see the LICENSE file for details