A Comprehensive Review on Deep Learning System Testing

Deep learning(DL) systems exhibit multiple behavioral characteristics such as correctness, robustness, and fairness. Ensuring that these behavioral characteristics function properly is crucial for maintaining the accuracy of DL systems’ outputs. As a specialized form of software, DL systems’ security testing techniques have increasingly become a focus of research in quality assurance. We analyze and organize the testing techniques for DL systems based on an investigation of the current state of the art both domestically and internationally. This paper categorizes existing approaches as component-oriented and attribute-oriented methods, providing a detailed review based on this classification. Additionally, we forecast the future development of testing techniques for DL systems.