hight-level-robotics-congnitive-agent/librealsense/wrappers/python/examples/box_dimensioner_multicam

Box dimensions calculation using multiple realsense camera

Requirements:

Python Version

This code requires Python 3.6 to work and does not work with Python 2.7.

Packages:

1. OpenCV
2. LibRealSense
3. Numpy

Get these packages using pip: pip install opencv-python numpy pyrealsense2

Aim

This sample demonstrates the ability to use the SDK for aligning multiple devices to a unified co-ordinate system in world to solve a simple task such as dimension calculation of a box.

Workflow

1. Place the calibration chessboard object into the field of view of all the realsense cameras. Update the chessboard parameters in the script in case a different size is chosen.
2. Start the program.
3. Allow calibration to occur and place the desired object ON the calibration object when the program asks for it. Make sure that the object to be measured is not bigger than the calibration object in length and width.
4. The length, width and height of the bounding box of the object is then displayed in millimeters.
   Note: To keep the demo simpler, the clipping of the usable point cloud is done based on the assumption that the object is placed ON the calibration object and the length and width is less than that of the calibration object.

Example Output

Once the calibration is done and the target object's dimensions are calculated, the application will open as many windows as the number of devices connected each displaying a color image along with an overlay of the calculated bounding box. In the following example we've used two Intel® RealSense™ Depth Cameras D435 pointing at a common object placed on a 6 x 9 chessboard (checked-in with this demo folder). sampleSetupAndOutput

References

Rotation between two co-ordinates using Kabsch Algorithm: Kabsch W., 1976, A solution for the best rotation to relate two sets of vectors, Acta Crystallographica, A32:922-923