Engineering Applications of Artificial Intelligence Volume 156, Part A, 15 September 2025, 111163

Semi-Supervised Dual-Constraint Centroid Contrastive Prototypical Network for Flip Chip Defect Detection under Limited Labeled Data

Yunxia Lou¹, Lei Su¹, Jiefei Gu¹, Y.L. Chan¹, Xinwei Zhao¹, Ke Li¹, and Michael G. Pecht^2
1 Jiangsu Key Laboratory of Advanced Food Manufacturing Equipment and Technology, School of Intelligent Manufacturing, Jiangnan University, China
² Center for Advanced Life Cycle Engineering, University of Maryland, College Park, MD, USA

For more information about this article and related research, please contact Prof. Michael Pecht.

Abstract:

Flip chips are widely used in electronic systems for defense, aerospace, and other applications where packaging reliability is critical. However, flip chip defect samples present a variety of defect types and few samples with labels in actual industrial applications. The paucity of labeled defect samples indicates that the existing data volume cannot be matched with deep learning detection models. Therefore, flip chip intelligent defect detection faces the problems of poor model adaptability and weak generalization performance. As a solution to these problems, a semi-supervised dual-constraint centroid contrastive prototypical network (SSDCPN) for flip chip defect detection under limited labeled data is proposed in this paper. First, a prototype-based supervised contrastive learning strategy is developed to construct the contrastive prototypical network, which increases the inter-class sparsity and intra-class compactness of features to acquire more discriminative features. Then, to address the susceptibility of the support set prototypes to outliers, dual constraints are imposed on the support set prototypes to calibrate and refine the prototypes. Finally, a pseudo-labeled sample selection mechanism based on epistemic uncertainty and entropy is proposed to obtain rich semi-supervised information to guide the model training. The mechanism can select high-confidence pseudo-labeled samples that can complement the training samples to further strengthen the generalization performance of the model. Defect detection experiments on flip chip vibration signals indicate that the present method is superior to other methods in the case of limited labeled samples.

This article is available for free until July 7, 2025 online here.