Scaling Model Checking for Neural Network Analysis via State-Space Reduction and Input Segmentation

23 pages•Published: October 23, 2023

Mahum Naseer, Osman Hasan and Muhammad Shafique

Abstract

Owing to their remarkable learning capabilities and performance in real-world applica- tions, the use of machine learning systems based on Deep Neural Networks (DNNs) has been continuously increasing. However, various case studies and empirical findings in the literature suggest that slight variations to DNN inputs can lead to erroneous and undesir- able DNN behavior. This has led to considerable interest in their formal analysis, aiming to provide guarantees regarding a given DNN’s behavior. Existing frameworks provide robust- ness and/or safety guarantees for the trained DNNs, using satisfiability solving and linear programming. We proposed FANNet, the first model checking-based framework for analyz- ing a broader range of DNN properties. However, the state-space explosion associated with model checking entails a scalability problem, making the FANNet applicable only to small DNNs. This work develops state-space reduction and input segmentation approaches, to improve the scalability and timing efficiency of formal DNN analysis. Compared to the state-of-the-art FANNet, this enables our new model checking-based framework to reduce the verification’s timing overhead by a factor of up to 8000, making the framework ap- plicable to DNNs even with approximately 80 times more network parameters. This in turn allows the analysis of DNN safety properties using the new framework, in addition to all the DNN properties already included with FANNet. The framework is shown to be efficiently able to analyze properties of DNNs trained on healthcare datasets as well as the well-acknowledged ACAS Xu networks.

Keyphrases: bias, formal analysis, input node sensitivity, noise tolerance, robustness, state space reduction

In: Nina Narodytska, Guy Amir, Guy Katz and Omri Isac (editors). Proceedings of the 6th Workshop on Formal Methods for ML-Enabled Autonomous Systems, vol 16, pages 6-28.

Links:	https://easychair.org/publications/paper/65SW
	https://doi.org/10.29007/7r6j

BibTeX entry

@inproceedings{FoMLAS2023:Scaling_Model_Checking_Neural,
  author    = {Mahum Naseer and Osman Hasan and Muhammad Shafique},
  title     = {Scaling Model Checking for Neural Network Analysis via State-Space Reduction and Input Segmentation},
  booktitle = {Proceedings of the 6th Workshop on Formal Methods for ML-Enabled Autonomous Systems},
  editor    = {Nina Narodytska and Guy Amir and Guy Katz and Omri Isac},
  series    = {Kalpa Publications in Computing},
  volume    = {16},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2515-1762},
  url       = {/publications/paper/65SW},
  doi       = {10.29007/7r6j},
  pages     = {6-28},
  year      = {2023}}

Download PDF Open PDF in browser