Calibration, Alignment & Mesh Deform
The calibration process triangulates the position of the blobs detected in a capture as well as the relative positions of cameras & projectors and their lens intrinsics.
Alignment is the process of marrying the point cloud coordinate system with that of Designer.
Calibration
- Once the calibration is completed, you can view the point cloud and check the error in pixels, for each projector.
- You may need to adjust the calibration parameters to get the best results, but usually these are chosen automatically.
Alignment
- Roughly align the point cloud manually with the projection surfaces in the visualiser.
- Add alignment points to the camera images to line up wireframe views of the projection surfaces with the captured reality.
- This only needs to be done once as long as cameras or projection surfaces do not move.
- Re-shape points can also be added to correct the shape of the mesh, this can be thought of as a 3D warp from the cameras point of view.
Detailed Workflow
Calibration
From this point, you no longer need access to the physical stage to continue the calibration process.
- Click Calibrate.
The system runs the calibration and reports the calibration results in the calibration results widget. The pixel error per camera & projector will be displayed at the bottom of this widget. Values below 1px are considered good, and above 1px usually points to something going wrong in the process.
The generated point cloud will appear in the stage visualiser at this point but will not be aligned to the stage, unless you previously performed an alignment.
Alignment
- The generated point cloud will be aligned to the stage based on the previously performed simulated calibration. If no simulated calibration has been performed, the point cloud will be un-aligned with the stage.
There are some automatic options to automatically align the point cloud to the stage. Click Quick Align, and choose Alignment Estimate which is automatic alignment estimation based on point cloud and all projection surfaces.
Align to plan cameras which is the automatic alignment based on positions of plan cameras.
Align to plan which aligns to plan cameras and projectors.
Align to point cloud is useful for alignment using 2D camera reference points. Use this option when you want to apply the current alignment data to the stage.
If the Alignment assistance tools do not work, proceed to the next step.
- Manually align the point cloud with the stage using Initial position, Initial rotation and Initial scale settings.
- Once the point cloud is roughly aligned, you can perform a Quick Align.
- Left-click Quick Align to open the Quick Align editor. The top two views relate to cameras which can be chosen from the view tab. The bottom two views relate to the cursor location in the camera view. This is essentially a zoomed in view, for better view finding.
- Create AlignmentPoints(AP).
- Left-click near a point on the wireframe to create an AP for this mesh vertex.
- Alternatively, AlignmentPoints can be imported from existing QuickCal projector ReferencePoints.
- Drag it to the corresponding point in the image. Do the same for the corresponding point in the second camera view.
- Repeat this process for a minimum of three points.
- Red point means this point is not being used as part of the alignment, but has been added to the view.
- Yellow means it has been aligned in the current camera, but it is not being used in the calculations.
- Orange means it has been aligned in a different camera.
- Green means it has been aligned in both cameras and is being used in the calculation.
- Selected points flash, and you can use the arrow keys to move them around.
- When points are selected, use SHIFT + arrow keys to move the point around & hold CTRL & left-click for fine control.
Alignment re-shape
If the proportions of the model are correct, the alignment should fit perfectly. If the proportions are not correct, you will need to perform a reshape. This can be done by holding SHIFT and left-clicking a point which will turn it into a reshape point. Left-clicking the point again will turn it back to a alignment point. A reshape does not use the point cloud, and simply adjusts the proportions of the model to match.
Multi-screen alignment
- The master screen should be aligned first.
- It not moved on the stage. It acts as a registration point for other screens. Reshaping or scaling of the Master screen will therefore affect all other screens.
- When aligning secondary screens, they will be moved to the correct position relative the Master screen.
- Its best to choose a screen that does not move, for a master screen.
Mesh deform
This may take a while, depending on mesh size, number of verticies and point cloud size.
If the depth of the mesh in does not match the real world object, it will require mesh deforming. Mesh deform will deform the mesh to match the point cloud.
It is a good idea to try the default settings for mesh deform first, to see if you get a good deform. If not, proceed to tweak the settings as required.
You can quickly preview Mesh deform results by changing the Point Cloud visualisation mode to Deform in the calibration editor. The results are updated in real-time so you can try out different deform settings using this. The lines indicate where each point on the mesh would be moved to.
- To perform a Mesh deform, click Mesh deform from the Alignment tab of the Plan editor.
- Select the screen you wish to deform by left-clicking the screen property in the deform editor.
- Left-click Deform.