Multi-View RGB-D 3D Point Cloud Reconstruction Using a Robotic Manipulator
Abstract
In this study, a multi-view RGB-D-based three-dimensional point cloud acquisition system is developed using a six-degree-of-freedom robotic manipulator within the Webots simulation environment. The robotic manipulator is actuated along semicircular arcs to position the RGB-D camera at predefined viewing angles, enabling simultaneous acquisition of color and depth images at each waypoint. Two mutually orthogonal semicircular scanning trajectories are employed to increase surface coverage, while the camera optical axis is continuously directed toward the object center throughout the scan. At each stable waypoint, RGB-D data and camera pose information are synchronously recorded. The resulting point cloud provides a geometrically consistent representation of the scanned object without requiring an additional point-cloud registration procedure. The results were first obtained for n = 7 waypoints per semicircular trajectory, and the corresponding error statistics were analyzed in detail. This analysis showed that the median distance between the point cloud generated using the ground-truth poses and the reference surface remained on the order of micrometers, indicating that the fusion pipeline introduced no measurable geometric error beyond that contained in the provided pose information. When the same frames were fused using the commanded poses, the mean surface error increased to 0.45 mm, corresponding to approximately 0.62 times the mean pose position error. Therefore, the scanning accuracy is determined by the positioning performance of the manipulator rather than the sensor model. Subsequently, the same trajectory geometry was rescanned with n=37 waypoints to evaluate the effect of sampling density comparatively. The comparison showed that increasing the number of waypoints reduced the median point spacing and improved cross-trajectory consistency approximately in proportion to the square root of the point density, while leaving the pose errors and geometric accuracy essentially unchanged.
Keywords
Supporting Institution
Project Number
Thanks
References
- [1] Fei, B., Xu, J., Li, Y., Yang, W., Zhou, Q., Liu, L., Luo, T., & He, Y. (2026). Self-Supervised Learning for Pre-Training 3D Point Clouds: A Survey. Computational Visual Media, 12(3),509-573. https://doi.org/10.26599/CVM.2025.9450514
- [2] Imran, M. M., Kim, Y., Jung, G., De Silva, L. C., Suh, J.-H., Abas, P. E., & Kim, Y. B. (2023). In-Situ Process Monitoring and Defects Detection Based on Geometrical Topography With Streaming Point Cloud Processing in Directed Energy Deposition. IEEE Access, 11, 131319- 131337. https://doi.org/10.1109/ACCESS.2023.3335130
- [3] Tychola, K.A., Vrochidou, E., & Papakostas, G.A. (2024). Deep learning based computer vision under the prism of 3D point clouds: a systematic review. The Visual Computer, 40, 8287–8329. https://doi.org/10.1007/s00371-023-03237-7
- [4] Wang, C., Wang, C., Li, W., & Wang, H. (2021). A brief survey on RGB-D semantic segmentation using deep learning. Displays, 70, 102080. https://doi.org/10.1016/j.displa.2021.102080
- [5] Xu, Y., Tong, X., & Stilla, U. (2021). Voxel-based representation of 3D point clouds: Methods, applications, and its potential use in the construction industry. Automation in Construction, 126, 103675. https://doi.org/10.1016/j.autcon.2021.103675
- [6] Komori, J., & Hotta, K. (2019, December). AB-PointNet for 3D Point Cloud Recognition. 2019 Digital Image Computing: Techniques and Applications (DICTA) (pp. 1- 6). IEEE. https://doi.org/10.1109/DICTA47822.2019.8945926
- [7] Luo, K., Yu, H., Chen, X., Yang, Z., Wang, J., Cheng, P., & Mian, A. (2024). 3D point cloud-based place recognition: a survey. Artificial Intelligence Review, 57. https://doi.org/10.1007/s10462-024-10713-6
- [8] Liu, Y., Yuan, H., Zhao, X., Fan, C., & Cheng, M. (2023). Fast reconstruction method of three-dimension model based on dual RGB-D cameras for peanut plant. Plant Methods, 19. https://doi.org/10.1186/s13007-023-00998-z
Details
Primary Language
English
Subjects
Software Architecture, Electrical Engineering (Other)
Journal Section
Research Article
Publication Date
October 30, 2026
Submission Date
September 24, 2026
Acceptance Date
October 23, 2026
Published in Issue
Year 2026 Volume: 14
