Computer Vision-Driven In-Situ Defect Detection and Geometrical Quality Assessment for Automated Composite Formwork Fabrication

Authors

  • Kerrie A. Delap Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS, USA. Author
  • Ema Recio Department of Computer Science, University of New Hampshire, Durham, NH, USA. Author

Keywords:

composite formwork; in-situ defect detection; geometric quality assessment; structured-light vision; uncertainty calibration; automated fabrication

Abstract

Automated fabrication of composite formwork creates a quality-control problem that cannot be solved reliably by post-process inspection alone. Defects such as voids, gaps, overlaps, wrinkling, fibre bridging, edge fraying, and local geometric deviation can be introduced layer by layer, while the material and tooling state remain accessible for correction. This manuscript develops a computer-vision-driven methodological framework for in-situ defect detection and geometrical quality assessment during automated composite formwork fabrication. The central contribution is an integrated inspection logic that combines calibrated multi-view structured-light imaging, learned defect segmentation, uncertainty estimation, scan-to-computer-aided-design registration, and a tolerance-aware acceptance rule. Two-dimensional defect evidence is not treated as a standalone classification output; it is fused with three-dimensional signed surface deviation and with calibrated predictive confidence. The framework defines an imaging model, a class-weighted segmentation objective, an entropy-based uncertainty measure, a signed-distance geometric deviation field, a defect-severity score, a calibration audit, and a final accept-or-review decision rule. Analytical assessment shows that the main failure modes are not only missed defects but also false rejection under specular highlights, registration bias at thin free edges, and spatial misalignment between defect masks and geometric deviation. The proposed decision logic makes those trade-offs explicit, supports targeted rework before subsequent layers are deposited, and provides a traceable basis for process control in large-scale composite formwork production.

References

1. Wang, J., Ma, Y., Zhang, L., Gao, R. X., & Wu, D. (2018). Deep learning for smart manufacturing: Methods and applications. Journal of Manufacturing Systems, 48, 144–156.

2. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 25, 1097–1105.

3. Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 3431–3440).

4. Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 (pp. 234–241). Springer.

5. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 770–778).

6. Bergmann, P., Fauser, M., Sattlegger, D., & Steger, C. (2019). MVTec AD—A comprehensive real-world dataset for unsupervised anomaly detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 9592–9600).

7. Gao, W., Zhang, Y., Ramanujan, D., Ramani, K., Chen, Y., Williams, C. B., Wang, C. C. L., Shin, Y. C., Zhang, S., & Zavattieri, P. D. (2015). The status, challenges, and future of additive manufacturing in engineering. Computer-Aided Design, 69, 65–89.

8. Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11), 1330–1334.

9. Salvi, J., Fernandez, S., Pribanic, T., & Llado, X. (2010). A state of the art in structured light patterns for surface profilometry. Pattern Recognition, 43(8), 2666–2680.

10. Gorthi, S. S., & Rastogi, P. (2010). Fringe projection techniques: Whither we are? Optics and Lasers in Engineering, 48(2), 133–140.

11. Besl, P. J., & McKay, N. D. (1992). A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 239–256.

12. Rusinkiewicz, S., & Levoy, M. (2001). Efficient variants of the ICP algorithm. In Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling (pp. 145–152). IEEE.

13. Kendall, A., & Gal, Y. (2017). What uncertainties do we need in Bayesian deep learning for computer vision? Advances in Neural Information Processing Systems, 30, 5574–5584.

14. Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017). On calibration of modern neural networks. In Proceedings of the 34th International Conference on Machine Learning (pp. 1321–1330). PMLR.

15. Savio, E., De Chiffre, L., Schmitt, R., & Müller, U. (2007). Metrology of freeform shaped parts. CIRP Annals, 56(2), 810–835.

16. Xin, Z. Y., Zhu, G. Q., Gattas, J. M., & Luo, D. (2025). Automated large-scale additive manufacturing of structural formwork with rapid fibre-reinforced polymer tape lamination. Automation in Construction, 171, 105978.

17. Wang, B., Zhong, S., Lee, T.-L., Fancey, K. S., & Mi, J. (2020). Non-destructive testing and evaluation of composite materials/structures: A state-of-the-art review. Advances in Mechanical Engineering, 12(4), 1687814020913761.

18. Lukaszewicz, D. H.-J. A., Ward, C., & Potter, K. D. (2012). The engineering aspects of automated prepreg layup: History, present and future. Composites Part B: Engineering, 43(3), 997–1009.

19. Wisnom, M. R. (2012). The role of delamination in failure of fibre-reinforced composites. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 370(1965), 1850–1870.

20. Boisse, P., Colmars, J., Hamila, N., Naouar, N., & Steer, Q. (2018). Bending and wrinkling of composite fiber preforms and prepregs. A review and new developments in the draping simulations. Composites Part B: Engineering, 141, 234–249.

Downloads

Published

2026-10-19