MPCR-Net: Multiple Partial Point Clouds Registration Network Using a Global Template
Source abstract
Abstract
With advancements in photoelectric technology and computer image processing technology, the visual measurement method based on point clouds is gradually being applied to the 3D measurement of large workpieces. Point cloud registration is a key step in 3D measurement, and its registration accuracy directly affects the accuracy of 3D measurements. In this study, we designed a novel MPCR-Net for multiple partial point cloud registration networks. First, an ideal point cloud was extracted from the CAD model of the workpiece and used as the global template. Next, a deep neural network was used to search for the corresponding point groups between each partial point cloud and the global template point cloud. Then, the rigid body transformation matrix was learned according to these correspondence point groups to realize the registration of each partial point cloud. Finally, the iterative closest point algorithm was used to optimize the registration results to obtain the final point cloud model of the workpiece. We conducted point cloud registration experiments on untrained models and actual workpieces, and by comparing them with existing point cloud registration methods, we verified that the MPCR-Net could improve the accuracy and robustness of the 3D point cloud registration.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: 3D Surveying and Cultural Heritage · 3D Shape Modeling and Analysis · Optical measurement and interference techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical Engineering, Jiangsu University of Science and Technology, Zhenjiang 212003, China
Plasma Environment Technology Group, Research Institute for Environmental Innovation (Suzhou) Tsinghua, Suzhou 215163, China
Complex Systems Monitoring, Modeling and Control Lab, The Pennsylvania State University, University Park, PA 16802, USA
Funding
Excellent Youth Foundation of Jiangsu Scientific Committee of China · Jiangsu Government Scholarship for Overseas Studies
References (47)
Show source-provided references
1. Enhanced phase measurement profilometry for industrial 3D inspection automation10.1007/s00170-014-6360-z ↗
2. Han, L., Cheng, X., Li, Z., Zhong, K., Shi, Y., and Jiang, H. (2018). A Robot-Driven 3D Shape Measurement System for Automatic Quality Inspection of Thermal Objects on a Forging Production Line. Sensors, 18.10.3390/s18124368 ↗
3. Liu, D., Chen, X., and Yang, Y.-H. (2014, January 23–28). Frequency-Based 3D Reconstruction of Transparent and Specular Objects. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.90 ↗
4. Self-organizing network modelling of 3D objects10.1016/j.cirp.2020.04.099 ↗
5. An automatic and robust point cloud registration framework based on view-invariant local feature descriptors and transformation consistency verification10.1016/j.optlaseng.2017.05.011 ↗
6. Pulli, K. (1999, January 8). Multiview registration for large data sets. Proceedings of the Second International Conference on 3-D Digital Imaging and Modeling (Cat. no. pr00062), Ottawa, ON, Canada.
7. Verdie, Y., Yi, K.M., Fua, P., and Lepetit, V. (2015, January 7–12). TILDE: A Temporally Invariant Learned DEtector. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7299165 ↗
8. Precise ellipse estimation without contour point extraction10.1007/s00138-008-0141-3 ↗
9. Deep learning based point cloud registration: An overview10.1016/j.vrih.2020.05.002 ↗
10. Charles, R.Q., Su, H., Kaichun, M., and Guibas, L.J. (2017, January 21–26). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.16 ↗
11. A method for registration of 3-D shapes, Pattern Analysis and Machine Intelligence10.1109/34.121791 ↗
12. Object modelling by registration of multiple range images10.1016/0262-8856(92)90066-C ↗
13. Rusinkiewicz, S., and Levoy, M. (June, January 28). Efficient variants of the ICP algorithm. Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, QC, Canada.
14. A symmetric objective function for ICP10.1145/3306346.3323037 ↗
15. Kamencay, P., Sinko, M., Hudec, R., Benco, M., and Radil, R. (2019, January 1–3). Improved feature point algorithm for 3D point cloud registration. Proceedings of the 2019 42nd International Conference on Telecommunications and Signal Processing (TSP), Budapest, Hungary.10.1109/TSP.2019.8769057 ↗
16. Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration10.1109/TPAMI.2015.2513405 ↗
17. Srivatsan Rangaprasad, A., Xu, M., Zevallos-Roberts, N., and Choset, H. (2017, January 12–16). Bingham Distribution-Based Linear Filter for Online Pose Estimation. Proceedings of the Robotics: Science and Systems XIII, Cambridge, MA, USA.10.15607/RSS.2017.XIII.016 ↗
18. Eckart, B., Kim, K., and Kautz, J. (2018). Fast and Accurate Point Cloud Registration using Trees of Gaussian Mixtures. arXiv.
19. Jost, T., and Hugli, H. (2002, January 19–21). A multi-resolution scheme ICP algorithm for fast shape registration. Proceedings of the First International Symposium on 3D Data Processing Visualization and Transmission, Padua, Italy.
20. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography10.1145/358669.358692 ↗
21. Chen, C.-S., Hung, Y.-P., and Cheng, J.-B. (1998, January 7). A fast automatic method for registration of partially-overlapping range images. Proceedings of the Sixth International Conference on Computer Vision (IEEE Cat. No. 98CH36271), Bombay, India.
22. Aiger, D., Mitra, N.J., and Cohen-Or, D. (2008). 4-points congruent sets for robust pairwise surface registration. ACM SIGGRAPH 2008 Papers, Proceedings of the SIGGRAPH ’08: Special Interest Group on Computer Graphics and Interactive Techniques Conference, Los Angeles, CA, USA, 11–16 August 2008, Association for Computing Machinery.10.1145/1399504.1360684 ↗
23. Mellado, N., Aiger, D., and Mitra, N.J. (2014). Super 4pcs fast global pointcloud registration via smart indexing. Computer Graphics Forum, Wiley Online Library.10.1111/cgf.12446 ↗
24. Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12–17). Fast point feature histograms (FPFH) for 3D registration. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.10.1109/ROBOT.2009.5152473 ↗
25. Frome, A., Huber, D., Kolluri, R., Bülow, T., and Malik, J. (2004, January 11–14). Recognizing objects in range data using regional point descriptors. Proceedings of the European Conference on Computer Vision, Prague, Czech Republic.10.1007/978-3-540-24672-5_18 ↗
26. Corsnet: 3d point cloud registration by deep neural network10.1109/LRA.2020.2970946 ↗
27. Zeng, A., Song, S., Niessner, M., Fisher, M., Xiao, J., and Funkhouser, T. (2017, January 21–26). 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.29 ↗
28. Pais, G.D., Ramalingam, S., Govindu, V.M., Nascimento, J.C., Chellappa, R., and Miraldo, P. (2020, January 14–19). 3DRegNet: A Deep Neural Network for 3D Point Registration. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00722 ↗
29. Lu, W., Wan, G., Zhou, Y., Fu, X., Yuan, P., and Song, S. (27–2, January 27). DeepVCP: An End-to-End Deep Neural Network for Point Cloud Registration. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00010 ↗
30. Li, J., Zhang, C., Xu, Z., Zhou, H., and Zhang, C. (2020, January 23–28). Iterative distance-aware similarity matrix convolution with mutual-supervised point elimination for efficient point cloud registration. Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK. Proceedings, Part XXIV 16, 2020.10.1007/978-3-030-58586-0_23 ↗
31. Qi, C.R., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018, January 18–23). Frustum PointNets for 3D Object Detection from RGB-D Data. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00102 ↗
32. Yuan, W., Khot, T., Held, D., Mertz, C., and Hebert, M. (2018, January 5–8). PCN: Point Completion Network. Proceedings of the 2018 International Conference on 3D Vision (3DV), Verona, Italy.10.1109/3DV.2018.00088 ↗
33. Aoki, Y., Goforth, H., Srivatsan, R.A., and Lucey, S. (2019, January 15–20). PointNetLK: Robust & Efficient Point Cloud Registration Using PointNet. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00733 ↗
34. Lucas, B.D., and Kanade, T. (1981, January 24–28). An Iterative Image Registration Technique with an Application to Stereo Vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada.
35. Wang, Y., and Solomon, J.M. (2019, January 27–28). Deep closest point: Learning representations for point cloud registration. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00362 ↗
36. Yuan, W., Eckart, B., Kim, K., Jampani, V., Fox, D., and Kautz, J. (2020, January 23–28). Deepgmr: Learning latent gaussian mixture models for registration. Proceedings of the European Conference on Computer Vision, Glasgow, UK.10.1007/978-3-030-58558-7_43 ↗
37. Sarode, V., Li, X., Goforth, H., Aoki, Y., Srivatsan, R.A., Lucey, S., and Choset, H. (2019). PCRNet: Point Cloud Registration Network using PointNet Encoding. arXiv.
38. Wang, Y., and Solomon, J.M. (2019). PRNet: Self-Supervised Learning for Partial-to-Partial Registration. arXiv.
39. Yew, Z.J., and Lee, G.H. (2020, January 14–19). RPM-Net: Robust Point Matching Using Learned Features. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01184 ↗
40. Choy, C., Dong, W., and Koltun, V. (2020, January 14–19). Deep Global Registration. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00259 ↗
41. Gojcic, Z., Zhou, C., Wegner, J.D., Guibas, L.J., and Birdal, T. (2020, January 13–19). Learning Multiview 3D Point Cloud Registration. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00183 ↗
42. Moenning, C., and Dodgson, N.A. (2003). Fast Marching Farthest Point Sampling, University of Cambridge, Computer Laboratory.
43. Olivas, E.S., Guerrero, J.D.M., Sober, M.M., Benedito, J.R.M., and Lopez, A.J.S. (2009). Handbook Of Research On Machine Learning Applications and Trends: Algorithms, Methods and Techniques-2 Volumes, IGI Global.10.4018/978-1-60566-766-9 ↗
44. Orts-Escolano, S., Morell, V., Garcia-Rodriguez, J., and Cazorla, M. (2013, January 4–9). Point cloud data filtering and downsampling using growing neural gas. Proceedings of the 2013 International Joint Conference on Neural Networks (IJCNN), Dallas, TX, USA.10.1109/IJCNN.2013.6706719 ↗
45. Sanyuan, Z., Fengxia, L., Yongmei, L., and Yonghui, R. (2013). A New Method for Cloud Data Reduction Using Uniform Grids, Springer.
46. Benhabiles, H., Aubreton, O., and Barki, H. (2013, January 22–24). Fast simplification with sharp feature preserving for 3D point clouds. Proceedings of the 11th International Symposium on Programming and Systems (ISPS), Algiers, Algeria.10.1109/ISPS.2013.6581492 ↗
47. Investigation on egg-shaped pressure hulls10.1016/j.marstruc.2016.11.005 ↗