Since its inception, many techniques for improving the performance of model checking have been developed: abstraction and reductions, logics and algorithms optimized for them, and statistical and bounded approaches - which have all turned model checking into a tool which is powering modern verification.
This thesis introduces the CNML family of models, a novel approach integrating deep learning techniques with model checking. We present three models: ContrastiveEncoder, SupervisedClassifier, and CounterTrace along with their architectures and the specialized datasets developed for their training. The ContrastiveEncoder employs contrastive learning to learn vector representations of LTL formulas and AIGER circuits. Building on this, the SupervisedClassifier demonstrates the feasibility of neural model checking by building on ContrastiveEncoder. The CounterTrace model further extends this concept by framing model checking as a sequence-to-sequence problem, enabling both classification and counterexample generation tasks.
We develop novel dataset augmentation techniques, including the transformation of SC-PAT3 and the introduction of formulaBreaking. We also present a pipeline for evaluating counterexample traces generated by the CounterTrace model.
Our experiments demonstrate that all three models effectively perform their respective tasks, with transformer architectures successfully generalizing to the semantics of LTL, AIGER, and counterexample traces.