Our team has competed in the first Verification of Neural Networks Competition (VNN-COMP) held at the International Conference on Computer-Aided Verification (CAV). The competition was friendly in the sense that toolkits were not ranked and the primary goal was to standardise and share relevant benchmarks to facilitate future progress in the field.

We competed with two toolkits, the Mixed Integer Linear Programming (MILP) based solver VENUS and the Symbolic Interval Propagation (SIP) based solver VeriNet; both toolkits were among the top-performing in several benchmarks. Moreover, our group also provided three MNIST fully connected networks used for benchmarking.

More information about the competition can be found here and the toolkits are available for download here.