Computer Vision-Assisted Quality Inspection of 3D-Printed Structures Using Deep Neural Networks

Authors

  • Randolf Grein Groth Department of Computer Science, University of New Hampshire, Durham, NH, USA. Author
  • Dewi van Mare School of Information Technology, University of Cincinnati, Cincinnati, OH, USA. Author

Keywords:

additive manufacturing; in-situ monitoring; semantic segmentation; uncertainty calibration; cost-sensitive decision making; porosity detection

Abstract

Layer-wise imaging in additive manufacturing generates large volumes of data whose interpretation remains largely manual or rule-based, a gap that keeps vision systems in the role of qualitative monitoring aids rather than qualification instruments. This paper develops a methodological framework for computer vision-assisted inspection of 3D-printed structures in which deep neural networks are embedded in an explicit chain running from image formation and build-frame registration through volumetric defect segmentation to a calibrated, cost-sensitive acceptance decision. The framework specifies an observation model that links surface reflectance and orientation to measured intensity, a similarity registration that places every layer image in the build coordinate frame so voxel labels remain geometrically consistent, and a three-dimensional encoder–decoder that predicts per-voxel class posteriors. The analysis shows why segmentation accuracy alone is an insufficient basis for inspection: uncalibrated posteriors displace operating points, and the cost-optimal decision threshold is fixed by the ratio between the cost of accepting a defective part and the cost of rejecting a sound one. Evaluation logic is specified at voxel, defect-instance, and part level, with an explicit treatment of registration error propagation, powder masking, specular reflection, and label noise inherited from computed tomography. The resulting specification separates what the network estimates from how a printed part is judged, and it identifies the conditions under which the separation holds.

References

1. Huang, Y., Leu, M. C., Mazumder, J., & Donmez, A. (2015). Additive manufacturing: Current state, future potential, gaps and needs, and recommendations. Journal of Manufacturing Science and Engineering, 137(1), 014001.

2. Everton, S. K., Hirsch, M., Stravroulakis, P., Leach, R. K., & Clare, A. T. (2016). Review of in-situ process monitoring and in-situ metrology for metal additive manufacturing. Materials & Design, 95, 431–445.

3. Grasso, M., & Colosimo, B. M. (2017). Process defects and in situ monitoring methods in metal powder bed fusion: A review. Measurement Science and Technology, 28(4), 044005.

4. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25 (pp. 1097–1105).

5. Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 3431–3440).

6. Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 (pp. 234–241). Springer.

7. Scime, L., & Beuth, J. (2018). A multi-scale convolutional neural network for autonomous anomaly detection and classification in a laser powder bed fusion additive manufacturing process. Additive Manufacturing, 24, 273–286.

8. Gobert, C., Reutzel, E. W., Petrich, J., Nassar, A. R., & Phoha, S. (2018). Application of supervised machine learning for defect detection during metallic powder bed fusion additive manufacturing using high resolution imaging. Additive Manufacturing, 21, 517–528.

9. Imani, F., Chen, R., Diewald, E., Reutzel, E., & Yang, H. (2019). Deep learning of variant geometry in layerwise imaging profiles for additive manufacturing quality control. Journal of Manufacturing Science and Engineering, 141(11), 111001.

10. Chen, D., Luo, D., Xu, W., Luo, C., Shen, L., Yan, X., & Wang, T. (2019, September). Re-perceive 3D printing with Artificial Intelligence. In Education and research in computer aided architectural design in Europe and XXIII Iberoamerican Society of Digital Graphics, joint conference (pp. 443-450).

11. Leach, R. K., Bourell, D., Carmignato, S., Donmez, A., Senin, N., & Dewulf, W. (2019). Geometrical metrology for metal additive manufacturing. CIRP Annals, 68(2), 677–700.

12. Yao, B., Imani, F., Sakpal, A. R., Reutzel, E. W., & Yang, H. (2018). Multifractal analysis of image profiles for the characterization and detection of defects in additive manufacturing. Journal of Manufacturing Science and Engineering, 140(3), 031014.

13. Zhao, C., Parab, N. D., Li, X., Fezzaa, K., Tan, C. L., Copley, A. D., Chen, L., & Sun, T. (2017). Real-time monitoring of laser powder bed fusion process using high-speed X-ray imaging and diffraction. Scientific Reports, 7(1), 3602.

14. Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016). 3D U-Net: Learning dense volumetric segmentation from sparse annotation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016 (pp. 424–432). Springer.

15. Milletari, F., Navab, N., & Ahmadi, S. A. (2016). V-Net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 Fourth International Conference on 3D Vision (pp. 565–571). IEEE.

16. Gal, Y., & Ghahramani, Z. (2016). Dropout as a Bayesian approximation: Representing model uncertainty in deep learning. In Proceedings of the 33rd International Conference on Machine Learning (pp. 1050–1059).

17. Kendall, A., & Gal, Y. (2017). What uncertainties do we need in Bayesian deep learning for computer vision? In Advances in Neural Information Processing Systems 30 (pp. 5574–5584).

18. Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017). On calibration of modern neural networks. In Proceedings of the 34th International Conference on Machine Learning (pp. 1321–1330).

19. Sensoy, M., Kaplan, L., & Kandemir, M. (2018). Evidential deep learning to quantify classification uncertainty. In Advances in Neural Information Processing Systems 31 (pp. 3179–3189).

20. Angelopoulos, A. N., & Bates, S. (2021). A gentle introduction to conformal prediction and distribution-free uncertainty quantification. arXiv preprint arXiv:2107.07511.

21. Elkan, C. (2001). The foundations of cost-sensitive learning. In Proceedings of the 17th International Joint Conference on Artificial Intelligence (pp. 973–978).

Downloads

Published

2026-10-01