journal article·2016-08

Auto‐calibration of a projector–camera stereo system for projection mapping

Jason Deglint, Andrew Cameron, Christian Scharfenberger, Hicham Sekkati, Mark Lamm, Alexander Wong, David A. Clausi

Publisher page

Abstract

Abstract Standard camera and projector calibration techniques use a checkerboard that is manually shown at different poses to determine the calibration parameters. Furthermore, when image geometric correction must be performed on a three‐dimensional (3D) surface, such as projection mapping, the surface geometry must be determined. Camera calibration and 3D surface estimation can be costly, error prone, and time‐consuming when performed manually. To address this issue, we use an auto‐calibration technique that projects a series of Gray code structured light patterns. These patterns are captured by the camera to build a dense pixel correspondence between the projector and camera, which are used to calibrate the stereo system using an objective function, which embeds the calibration parameters together with the undistorted points. Minimization is carried out by a greedy algorithm that minimizes the cost at each iteration with respect to both calibration parameters and noisy image points. We test the auto‐calibration on different scenes and show that the results closely match a manual calibration of the system. We show that this technique can be used to build a 3D model of the scene, which in turn with the dense pixel correspondence can be used for geometric screen correction on any arbitrary surface.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Vision and Imaging · Optical measurement and interference techniques · 3D Surveying and Cultural Heritage

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Systems Design Engineering University of Waterloo Waterloo Ontario Canada

Christie Digital Systems Kitchener Ontario Canada

References (23)

Show source-provided references
1. 10.1016/j.patcog.2003.10.00210.1016/j.patcog.2003.10.002 ↗
2. 10.1109/34.88871810.1109/34.888718 ↗
3. J. Y.Bouguet Camera calibration toolbox for MATLAB(nd).
4. D.MorenoandG.Taubin “Simple accurate and robust projector–camera calibration ” in3D Imaging Modeling Processing Visualization and Transmission (3DIMPVT) 2012 Second International Conference on 2012 pp. 464–471.10.1109/3DIMPVT.2012.77 ↗
5. S.Yamazakiet al. “Simultaneous self‐calibration of a projector and a camera using structured light ” inProc. Projector Camera Systems 2011 pp. 67–74.10.1109/CVPRW.2011.5981781 ↗
6. I.Garcia‐DoradoandJ.Cooperstock “Fully automatic multi‐projector calibration with an uncalibrated camera ” inComputer Vision and Pattern Recognition Workshops (CVPRW) 2011 IEEE Computer Society Conference on 2011 pp. 29–36.10.1109/CVPRW.2011.5981726 ↗
7. 10.1016/j.patcog.2003.10.00210.1016/j.patcog.2003.10.002 ↗
8. M.Fiala Automatic projector calibration using self‐identifying patterns in:Computer Vision and Pattern Recognition – Workshops 2005 2005.
9. R.Yanget al. “Camera based calibration techniques for seamless flexible multi-projector displays.”IEEE TVCG(2005).
10. R.RaskarandP.Beardsley “A self‐correcting projector ” inComputer Vision and Pattern Recognition (CVPR) 2001.
11. 10.1109/TPAMI.2005.23510.1109/TPAMI.2005.235 ↗
12. A.RaijandM.Pollefeys “Auto‐calibration of multi‐projector display walls ” inInternational Conference on Pattern Recognition (ICPR) 2004.10.1109/ICPR.2004.1333994 ↗
13. 10.1007/s11263-009-0242-010.1007/s11263-009-0242-0 ↗
14. T.Liet al. “Geometric calibration of a camera–projector 3D imaging system” inImage and Vision Computing New Zealand (IVCNZ) 2010 25th International Conference of 2010 pp. 1–8.10.1109/IVCNZ.2010.6148798 ↗
15. M.‐A.Drouinet al. “Camera‐projector matching using an unstructured video stream ” inComputer Vision and Pattern Recognition Workshops (CVPRW) 2010 IEEE Computer Society Conference on 2010 pp. 33–40.10.1109/CVPRW.2010.5543474 ↗
16. 10.1007/s00138-011-0358-410.1007/s00138-011-0358-4 ↗
17. 10.1109/TVCG.2015.245989810.1109/TVCG.2015.2459898 ↗
18. R.HartleyandC.Silpa‐Anan “Reconstruction from two views using approximate calibration ” inProc. 5th Asian Conf. Comput. Vision Vol. 1 2002 pp. 338–343.
19. L.Zhanget al. “Rapid shape acquisition using color structured light and multi‐pass dynamic programming ” in 3DData Processing Visualization and Transmission 2002. Proceedings. First International Symposium on 2002 pp. 24–36.10.1109/TDPVT.2002.1024035 ↗
20. 10.1017/CBO978051181168510.1017/CBO9780511811685 ↗
21. 10.1109/TIP.2014.238035110.1109/TIP.2014.2380351 ↗
22. C.Scharfenbergeret al. “Fieguth Image saliency detection via multi‐scale statistical non‐redundancy modeling ” inIEEE Conference on Image Processing 2014.10.1109/ICIP.2014.7025872 ↗
23. C.Scharfenbergeret al. “Existence detection of objects in images for robot vision using saliency histogram features ” in10th Conference on Computer and Robot Vision 2013.10.1109/CRV.2013.25 ↗