CAMERA SELF-CALIBRATION BY USING SfM BASED DENSE MATCHING FOR CLOSE-RANGE IMAGES

Abstract

The camera calibration is an important issue that must be overcome to getting metric scene measurement. The imaging parameters are estimated by calibration of the camera. Basically, the camera calibration is performed individually from the photogrammetric evaluation. Today, 3-D point cloud generation and the camera calibration are usually attained simultaneously by using SfM approach photogrammetric evaluation. Stereo images that do not have camera intrinsic parameters can also be evaluated by SfM based photogrammetry. In this study, camera calibration models were investigated for point cloud generation of close-range photogrammetry. The results shown that self-calibration of loop-close images enables the close results to the pre-calibration. Otherwise, the images should be convergent as far as possible or projection-to-sparse point cloud ratio must be raised. The results show that the projection-to-sparse point cloud ratio of 13.22 created high accuracy to self-calibration. Consequently, the pre-calibration requires extra computation and time. However the self-calibration can be implemented for high accuracy measurement subject to convergence imaging or sufficient number of projection.

Keywords

• Camera calibration
• Demse matching
• Image matching
• Self-calibration
• Point cloud

References

1. N. Micheletti, J. H. Chandler,, and S. N. Lane, “Structure from motion (SFM) photogram-metry.” In: Clarke LE, Nield JM (Eds.) Geomorphological Techniques (Online Edi-tion), https://dspace.lboro.ac.uk/ dspace-jspui/bitstream/2134/17493/3/2.2.2_sfm.pdf, [Access:3 January 2018] (ISSN:2047-0371), 2015
2. F. He, T. Zhou, W. Xiong, S. M. Hasheminnasab, and A. Habib, “Automated aerial triangulation for UAV-based mapping,” Remote Sensing, vol. 10, no. 12, 1952, 2018.
3. D. Akca, and A. Gruen, “Comparative geometric and radiometric evaluation of mobile phone and still video cameras,” The Photogrammetric Record, vol. 24, no. 127, pp. 217–245, 2009.
4. S. M. Hasheminasab, T. Zhou, and A. Habib, “GNSS/INS-assisted structure from motion strategies for UAV-based imagery over mechanized agricultural fields,” Remote Sensing, vol. 12, no. 3, 351, 2020.
5. F. Schaffalitzky, and A. Zisserman, Multi-view matching for unordered image sets, or how do I organize my holiday snaps?,” ECCV 2002, Part I. LNCS 2350, Springer, Heidelberg, 2002.
6. M. Calonder, V. Lepetit, C. Strecha, and P. Fua, “BRIEF: binary robust independent elementary features,” ECCV 2010, LNCS 6314, Springer, Berlin Heidelberg, 2010.
7. J. Salvi, X. Armangu, and J. Bat, “A comparative review of camera calibrating methods with accuracy evaluation,” Pattern Recognition, vol. 35, no. 7, pp. 1617–1635, 2002.
8. C. S. Fraser, “Automatic camera calibration in close range photogrammetry,” PE&RS, vol. 79, no. 4, pp. 381–388, 2013.

9. R. Hartley, and A. Zisserman, “Multiple View Geometry in Computer Vision,” Second Edition, Cambridge University Press, 2004.
10. D. Griffiths, and H. Burningham, “Comparison of pre-and self-calibrated camera calibration models for UAS-derived nadir imagery for a SfM application,“ Progress in Physical Geography: Earth and Environment, vol. 43, no. 2, pp. 215-235, 2019.
11. S. Amelio, and M. L. Brutto, “Close range photogrammetry for measurement of paintings surface deformations,” International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XXXVIII-5/W1, pp. 1–6, 2009.
12. M. Scaioni, T. Feng, P. Lu, G. Qiao, X. Tong, R. Li, L. Barazzetti, M. Previtali, and R. Roncellaet, “Close-range photogrammetric techniques for deformation measurement: Applications to landslides," In: Scaioni M (eds) Modern Technologies for Landslide Monitoring and Prediction. Springer Natural Hazards. Springer, Berlin, Heidelberg, 2015.
13. T. Luhmann, “Close range photogrammetry for industrial applications,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 65, no. 6, pp. 558-569, 2010.
14. S. Lee, J. Kim, C. Jin, S. Bae, and C. Choi, “Assesment of smartphone-based technology for remote environmental monitoring and its development,” Instrumentation Science and Technology, vol. 40, no. 6, pp. 504-529, 2012.
15. L. D. Desmon, and P. G. Bryan, “Recording architecture at the archaeological site of Uxmal, Mexico: A historical and contemporary view,” Photogrammetric Record, vol. 18, no. 102, pp. 105-130, 2003.
16. A. Grün, F. Remondino, and L. Zhang, “Photogrammetric reconstruction of The Great Budha of Baminyan, Afghanistan,” Photogrammetric Record, vol. 19, no. 107, pp. 177-199, 2004.
17. S. Cronk, C. Fraser, and H. Hanley, “Automated metric calibration of colour digital cameras,” The Photogrammetric Record, vol. 21, no. 116, pp. 355–372, 2006.
18. T. Labe, and W. Förstner,“Geometric stability of low-cost digital consumer cameras,” Int. Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 35/5, part (B), pp. 528-535, 2004.
19. R. Wackrow, J. H. Chandler, and P. Bryan, “Geometric consistency and stability of consumer-grade digital cameras for accurate spatial measurement,” The Photogrammetric Record, vol. 22, no. 118, pp. 121–134, 2007.
20. F. Remondino, and C. Fraser, “Digital camera calibration methods: considerations and comparisons,” Int. Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XXXVI, part 5, pp. 266-272, 2006.
21. E. L. Hall, J. B. K. Tio, C. A. McPherson, and F. A. Sadjadi, “Measuring curved surfaces for robot vision,” IEEE Computer, vol. 15, no. 12, pp. 42–54, 1982.
22. O. D. Faugeras, and G. Toscani, “The calibration problem for stereo,” Proceedings of the IEEE Computer Vision and Pattern Recognition, Miami Beach FL, pp. 15–20, 1986.
23. J. Wang, F. Shi, J. Zhang, and Y. Liu, “A new calibration model of camera lens distortion,” Pattern Recognition, vol. 41, pp. 607–615, 2008.
24. J. Sun, X. Chen, Z. Gong, Z. Liu, and Y. Zhao, “Accurate camera calibration with distortion models using sphere images,” Optics and Laser Technology, vol. 65, pp. 83-87, 2015.
25. R. Y. Tsai, “A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the shelf TV cameras and lenses,” IEEE International Journal Robotics and Automation, vol. RA-3, no. 4, pp. 323–344, 1987.
26. G. Q. Wei, and S. D. Ma, “Implicit and explicit camera calibration: Theory and experiments,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, no. 5, pp. 469–480, 1994.
27. J. Weng, P. Cohen, and M. Herniou, “Camera calibration with distortion models and accuracy evaluation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, pp. 965–980, 1992.
28. P. Fasogbon, L. Duvieubourg, and L. Macaire, “Scheimpflug Camera Calibration Using Lens Distortion Model,” In: Raman B., Kumar S., Roy P., Sen D. (eds) Proceedings of International Conference on Computer Vision and Image Processing. Advances in Intelligent Systems and Computing, Springer, Singapore, vol 459, doi:10.1007/978-981-10-2104-6_15, 2017.
29. Y. Chen, H. Ip, Z. Huang, and G. Wang, “Full Camera Calibration from a Single View of Planar Scene.” In: Bebis G. et al. (eds) Advances in Visual Computing. ISVC 2008. Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, vol 5358, doi:10.1007/978-3-540-89639-5_78, 2008.
30. M. E. Amestoy, and O. F. Ortiz, “Global Positioning from a Single Image of a Rectangle in Conical Perspective,” Sensors, vol. 19, no. 24, 5432, 2019.
31. F. Bukhari, and M. Dailey, “Robust Radial Distortion from a Single Image”, In: Bebis G. et al. (eds) Advances in Visual Computing. ISVC 2010. Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, vol 6454, doi:10.1007/978-3-642-17274-8_2, 2010.
32. J. Fryer, and D. Brown, “Lens distortion for close-range photogrammetry,” PE&RS, vol. 52, no. 1, pp. 51-58, 1986.
33. R. Wang, G. Jiang, L. Quan, and C. Wu, “Camera calibration using lengths of corresponding line segments,” IEEE Xplore, 11705338, 2010.
34. M. Mozerov, A. Amato, M. Al-Haj, and J. Gonzalez, “A Simple Method of Multiple Camera Calibration for the Joint Top View Projection,” In: Kurzynski M., Puchala E., Wozniak M., Zolnierek A. (eds) Computer Recognition Systems 2. Advances in Soft Computing, vol 45. Springer, Berlin, Heidelberg, doi:10.1007/978-3-540-75175-5_21, 2007.
35. H. T. Chen, “Geometry-Based Camera Calibration Using Five-Point Correspondences From a Single Image,” IEEE Transactions on Circuits and systems for Video Technology, vol. 27, no. 12, pp. 2555-2566, 2017.
36. Y. Civera, D. R. Bueno, A. J. Davison, and J. M. M. Montiel, “Camera self-calibration for sequential Bayesian structure from motion,” IEEE Xplore, pp. 3411-3416, doi: 10.1109/ROBOT.2009.5152719, 2009.
37. Y. Furukawa, and J. Ponce, “Accurate camera calibration from multi-view stereo and bundle adjustment,” International Journal of Computer Vision, vol. 84, pp. 257-268, 2009.
38. E. Ito, and T. Okatani, “Self-calibration-based approach to critical motion sequences of rolling-shutter structure from motion,” IEEE Xplore, 17363558, pp. 4512-4520, 2017.
39. C. S. Fraser, “Digital camera self-calibration,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 52, no. 4, pp. 149-159, 1997.
40. C. Ressl, “Geometry, constraints and computation of the trifocal tensor,” PhD Thesis, Reviewer: W. Förstner, H. Pottmann; Institut für Photogrammetrie und Fernerkundung, 2003.
41. D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.