journal article·2020-12

Adaptive vision-based detection of laser-material interaction for directed energy deposition

Mohamed A. Naiel, Deniz Sera Ertay, Mihaela Vlasea, Paul Fieguth

Publisher page

Abstract

Abstract In-situ vision data acquisition, feature extraction, and analysis are ongoing challenges for quality assessment in directed energy deposition (DED). This work proposes a method for detecting target regions in the laser-material interaction zone based on a low-cost high-dynamic-range (HDR) vision sensor. Adaptive image thresholding, connected component analysis, and iterative energy minimization are used to identify target regions. The method is designed to be adaptive, in terms of obtaining parameters based on simple training data, and robust, in terms of feature detection performance subject to under-melt, conduction and keyhole melting mode phenomena. The performance of the proposed region detection scheme is quantitatively and qualitatively evaluated against annotated data. It was found that the True Positive Rate in detection was above 90%, while the False Detection Rate was less than 10%. Extensive experimental results show that the proposed scheme is able to detect and follow target regions under a variety of power levels and process conditions.
Source: openaire · Quality: candidate unverified · Source record ↗

Research context

OpenAlex topics: Welding Techniques and Residual Stresses · Additive Manufacturing Materials and Processes · Thermography and Photoacoustic Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (56)

Show source-provided references
1. Laser based additive manufacturing in industry and academia10.1016/j.cirp.2017.05.011 ↗
2. Laser cladding of aerospace materials10.1016/S0924-0136(01)01121-9 ↗
3. Quality control of laser- and powder bed-based additive manufacturing (AM) technologies10.1016/j.phpro.2010.08.089 ↗
4. Niyanth · 2018
5. Monitoring of laser consolidation process of metal powder with high speed video camera10.1016/j.phpro.2012.10.098 ↗
6. Review of in-situ process monitoring and in-situ metrology for metal additive manufacturing10.1016/j.matdes.2016.01.099 ↗
7. Formation processes for large ejecta and interactions with melt pool formation in powder bed fusion additive manufacturing10.1038/s41598-019-41415-7 ↗
8. Vision-based process monitoring for laser metal deposition processes
9. Process defects and in situ monitoring methods in metal powder bed fusion: a review10.1088/1361-6501/aa5c4f ↗
10. Melt pool sensing and size analysis in laser powder-bed metal additive manufacturing10.1016/j.jmapro.2018.04.002 ↗
11. Sensor-based build condition monitoring in laser powder bed fusion additive manufacturing process using a spectral graph theoretic approach10.1115/1.4040264 ↗
12. Feedback control of layerwise laser melting using optical sensors10.1016/j.phpro.2010.08.078 ↗
13. In-process sensing in selective laser melting (SLM) additive manufacturing10.1186/s40192-016-0045-4 ↗
14. Design of an optical system for the in situ process monitoring of selective laser melting (SLM)10.1016/j.phpro.2011.03.085 ↗
15. Estimation of melt pool size by complementary use of external illumination and process emission in coaxial monitoring of selective laser melting10.2351/1.5096117 ↗
16. Determination of geometrical factors in layerwise laser melting using optical process monitoring10.1016/j.optlaseng.2011.06.016 ↗
17. Performance characterization of process monitoring sensors on the NIST additive manufacturing metrology testbed
18. 3D spatial reconstruction of thermal characteristics in directed energy deposition through optical thermal imaging10.1016/j.jmatprotec.2015.02.021 ↗
19. Complementary use of pulsed and continuous wave emission modes to stabilize melt pool geometry in laser powder bed fusion10.1016/j.optlastec.2018.12.005 ↗
20. Qualification of channels produced by laser powder bed fusion: Analysis of cleaning methods, flow rate and melt pool monitoring data
21. Melt pool monitoring for laser beam melting of metals: Assistance for material qualification for the stainless steel 1.405710.1016/j.procir.2018.08.058 ↗
22. Optical in-situ monitoring and correlation of density and mechanical properties of stainless steel parts produced by selective laser melting process based on varied energy density10.1016/j.jmatprotec.2019.04.026 ↗
23. Prediction of lack of fusion porosity in selective laser melting based on melt pool monitoring data
24. Steen · 2010
25. Majumdar · 2012
26. Measurement of the melt pool length during single scan tracks in a commercial laser powder bed fusion process10.1115/1.4037571 ↗
27. Monitoring and adaptive control of laser processes10.1016/j.phpro.2014.08.038 ↗
28. Preliminary investigation of keyhole phenomena during single layer fabrication in laser additive manufacturing of stainless steel10.1016/j.phpro.2015.11.052 ↗
29. Online measurement of bead geometry in GMAW-based additive manufacturing using passive vision10.1088/0957-0233/24/11/115103 ↗
30. Initial work on the characterization of additive manufacturing (3D printing) using software image analysis10.3390/machines3020055 ↗
31. Extraction and evaluation of melt pool, plume and spatter information for powder-bed fusion am process monitoring10.1016/j.matdes.2018.07.002 ↗
32. Toward determining melt pool quality metrics via coaxial monitoring in laser powder bed fusion10.1016/j.mfglet.2018.02.009 ↗
33. Anomaly detection and classification in a laser powder bed additive manufacturing process using a trained computer vision algorithm
34. A statistical learning method for image-based monitoring of the plume signature in laser powder bed fusion10.1016/j.rcim.2018.11.007 ↗
35. In-situ monitoring of laser-based PBF via off-axis vision and image processing approaches
36. Using machine learning to identify in-situ melt pool signatures indicative of flaw formation in a laser powder bed fusion additive manufacturing process
37. Semi-supervised convolutional neural networks for in-situ video monitoring of selective laser melting
38. Analysis of melt pool characteristics and process parameters using a coaxial monitoring system during directed energy deposition in additive manufacturing10.3390/ma12020308 ↗
39. Process control of laser conduction welding by thermal imaging measurement with a color camera10.1364/AO.44.006841 ↗
40. The metallurgy and processing science of metal additive manufacturing10.1080/09506608.2015.1116649 ↗
41. Effect of processing parameters on microstructure and tensile properties of austenitic stainless steel 304l made by directed energy deposition additive manufacturing10.1016/j.actamat.2016.03.019 ↗
42. Melt pool image process acceleration using general purpose computing on graphics processing units
43. Pedestrian detection: An evaluation of the state of the art10.1109/TPAMI.2011.155 ↗
44. Goldberg · 1989
45. A globally convergent augmented lagrangian algorithm for optimization with general constraints and simple bounds10.1137/0728030 ↗
46. A globally convergent augmented lagrangian barrier algorithm for optimization with general inequality constraints and simple bounds10.1090/S0025-5718-97-00777-1 ↗
47. Observation of keyhole-mode laser melting in laser powder-bed fusion additive manufacturing10.1016/j.jmatprotec.2014.06.005 ↗
48. A simple methodology for predicting laser-weld properties from material and laser parameters10.1088/0022-3727/44/44/445401 ↗
49. A processing diagram for high-density Ti-6Al-4V by selective laser melting10.1108/RPJ-11-2017-0228 ↗
50. Density of additively-manufactured 316l SS parts using laser powder-bed fusion at powers up to 400 W10.1007/s00170-014-5954-9 ↗
51. The Pascal visual object classes (VOC) challenge10.1007/s11263-009-0275-4 ↗
52. "Sample qualitative results.” https://youtube/m2Jx4tahmE. Last accessed on July 26th, 2020.
53. Vision-based melt pool monitoring system setup for additive manufacturing
54. Effect of real-time cooling rate on microstructure in laser additive manufacturing10.1016/j.jmatprotec.2016.01.017 ↗
55. Modeling of laser keyhole welding: Part II. simulation of keyhole evolution, velocity, temperature profile, and experimental verification10.1007/s11661-002-0191-5 ↗
56. Illumination and image processing for real-time control of directed energy deposition additive manufacturing