Benchmark Setup
| Benchmark | 2LS | Bubaak | Bubaak-SpLit | CBMC | CPA-BAM-BnB | CPA-BAM-SMG | CPAchecker | DIVINE | ESBMC-kind | Goblint | Graves-CPA | Infer | Mopsa | Nacpa | PeSCo-CPA | SVF-SVC | Symbiotic | UAutomizer | UKojak | UTaipan |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Tool | 2LS 0.10.0 | Bubaak 0.9.4-9acbfd | Bubaak-SpLit 0.9.4-9acbfd | CBMC 5.70.0 (cbmc-5.70.0-121-g4f69955d00) | CPA-BAM-BnB 1.9.2-svn-35460 | CPA-BAM-SMG 2.0.1-svn-38892M | CPAchecker 4.0 | DIVINE 4.4.2+a865ee1d0086 | ESBMC-kind version 7.7.0 64-bit x86_64 linux | Goblint tags/svcomp25-0-g5512d834b | Graves-CPA 2.0.1-svn-a45b42da2f+ | Infer sv-comp-24 | Mopsa 1.0 (git branch:feature/sv-comp commit:295e3e262 commit-date:2024-11-23 10:10:19 +0100) | Nacpa 1.0.0 | PeSCo-CPA 2.1+2.2.1-svn-e677b7cd46+ | SVF-SVC 1.4 using SVF 3.0 | Symbiotic 10.0.0-rc1-f6104f53 | UAutomizer 0.3.0-d790fecc | UKojak 0.3.0-d790fecc | UTaipan 0.3.0-d790fecc |
| Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 |
| Host | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* | apollon* |
| OS | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-50-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-50-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic | Linux 6.8.0-49-generic |
| Selected date | ||||||||||||||||||||
| Date of execution | 2024-11-29 11:00:37 CET | 2024-11-29 13:23:21 CET | 2024-11-29 23:04:32 CET | 2024-12-09 14:22:17 CET | 2024-12-09 15:02:47 CET | 2024-12-09 17:24:44 CET | 2024-11-30 06:09:11 CET | 2024-12-10 08:22:51 CET | 2024-12-02 10:54:34 CET | 2024-11-29 20:22:51 CET | 2024-12-10 14:44:07 CET | 2024-12-12 03:12:57 CET | 2024-12-02 20:14:42 CET | 2024-12-03 05:22:17 CET | 2024-12-13 11:12:50 CET | 2024-12-03 11:18:25 CET | 2024-12-01 13:17:06 CET | 2024-11-30 15:04:55 CET | 2024-12-05 21:20:14 CET | 2024-12-05 21:21:41 CET |
| Run set | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] | [SV-COMP25_no-overflow.SoftwareSystems-BusyBox-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-coreutils-NoOverflows; SV-COMP25_no-overflow.SoftwareSystems-uthash-NoOverflows; SV-COMP25_termination.SoftwareSystems-DeviceDriversLinux64-Termination; SV-COMP25_unreach-call.SoftwareSystems-AWS-C-Common-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-DeviceDriversLinux64Large-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Intel-TDX-Module-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-Other-ReachSafety; SV-COMP25_unreach-call.SoftwareSystems-uthash-ReachSafety; SV-COMP25_valid-memcleanup.SoftwareSystems-uthash-MemCleanup; SV-COMP25_valid-memsafety.SoftwareSystems-coreutils-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-DeviceDriversLinux64-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-Other-MemSafety; SV-COMP25_valid-memsafety.SoftwareSystems-uthash-MemSafety] |
| Options |
--graphml-witness witness.graphml |
-sv-comp -sv-comp-witness witness.graphml -timeout 900 |
-sv-comp -sv-comp-witness witness.graphml -cfg splitting-svcomp25 |
--graphml-witness witness.graphml |
-svcomp21-bam-bnb -disable-java-assertions -heap 10000m |
-svcomp22-bam-smg -disable-java-assertions -heap 10000m -setprop counterexample.export.graphml=witness.graphml -setprop cpa.arg.proofWitness=witness.graphml -setprop termination.violation.witness=witness.graphml -setprop counterexample.export.compressWitness=false -setprop cpa.arg.compressWitness=false |
--svcomp25 --heap 10000M --benchmark --timelimit 900 s |
-s kinduction |
--conf conf/svcomp25.json |
-svcomp23-graves -heap 10000M -benchmark -timelimit 900 s |
--memory 10000M --timelimit 900 |
--witness witness.graphml |
--witness witness.graphml --sv-comp |
--full-output |
--full-output |
--full-output |
Statistics
| 2LS 2024-11-29 11:00:37 CET | Bubaak 2024-11-29 13:23:21 CET | Bubaak-SpLit 2024-11-29 23:04:32 CET | CBMC 2024-12-09 14:22:17 CET | CPA-BAM-BnB 2024-12-09 15:02:47 CET | CPA-BAM-SMG 2024-12-09 17:24:44 CET | CPAchecker 2024-11-30 06:09:11 CET | DIVINE 2024-12-10 08:22:51 CET | ESBMC-kind 2024-12-02 10:54:34 CET | Goblint 2024-11-29 20:22:51 CET | Graves-CPA 2024-12-10 14:44:07 CET | Infer 2024-12-12 03:12:57 CET | Mopsa 2024-12-02 20:14:42 CET | Nacpa 2024-12-03 05:22:17 CET | PeSCo-CPA 2024-12-13 11:12:50 CET | SVF-SVC 2024-12-03 11:18:25 CET | Symbiotic 2024-12-01 13:17:06 CET | UAutomizer 2024-11-30 15:04:55 CET | UKojak 2024-12-05 21:20:14 CET | UTaipan 2024-12-05 21:21:41 CET | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| all results | 4508 | 258 | 110000 | 11000000 | 4508 | 1765 | 1900000 | 6600000 | 4508 | 1678 | 2600000 | 10000000 | 4508 | -5465 | 2400000 | 23000000 | 4508 | 2902 | 870000 | 7400000 | 4508 | 1960 | 1000000 | 8100000 | 4508 | 3764 | 1100000 | 8300000 | 4508 | 705 | 450000 | 2300000 | 4508 | 1372 | 1700000 | 23000000 | 4508 | 3072 | 990000 | 7100000 | 4508 | 2828 | 1600000 | 12000000 | 4508 | -30413 | 230000 | 3000000 | 4508 | 4424 | 1800000 | 1600000 | 4508 | 3706 | 1400000 | 10000000 | 4508 | 1794 | 1400000 | 11000000 | 4508 | 0 | 730 | 110000 | 4508 | 2522 | 1600000 | 21000000 | 4508 | 2839 | 2300000 | 13000000 | 4508 | 2138 | 2400000 | 13000000 | 4508 | 2489 | 2300000 | 11000000 |
| correct results | 181 | 354 | 62 | 4900 | 1118 | 1813 | 95000 | 290000 | 1090 | 1758 | 22000 | 140000 | 429 | 599 | 8500 | 130000 | 1742 | 3430 | 90000 | 1500000 | 1869 | 3592 | 91000 | 1600000 | 2022 | 3764 | 110000 | 1700000 | 370 | 737 | 9700 | 250000 | 1265 | 2476 | 22000 | 290000 | 1536 | 3072 | 68000 | 670000 | 1781 | 3356 | 84000 | 2000000 | 272 | 355 | 1500 | 52000 | 2212 | 4424 | 73000 | 230000 | 2000 | 3706 | 81000 | 2200000 | 1837 | 3458 | 150000 | 1900000 | 0 | - | - | - | 1487 | 2554 | 22000 | 350000 | 1520 | 2903 | 140000 | 1500000 | 1073 | 2138 | 100000 | 1300000 | 1333 | 2617 | 130000 | 1400000 |
| correct true | 173 | 346 | 59 | 4800 | 695 | 1390 | 92000 | 220000 | 668 | 1336 | 14000 | 67000 | 170 | 340 | 4100 | 53000 | 1688 | 3376 | 85000 | 1500000 | 1723 | 3446 | 85000 | 1500000 | 1742 | 3484 | 100000 | 1500000 | 367 | 734 | 9500 | 240000 | 1211 | 2422 | 22000 | 280000 | 1536 | 3072 | 68000 | 670000 | 1575 | 3150 | 76000 | 1900000 | 83 | 166 | 210 | 13000 | 2212 | 4424 | 73000 | 230000 | 1706 | 3412 | 73000 | 1800000 | 1621 | 3242 | 140000 | 1800000 | 0 | - | - | - | 1067 | 2134 | 8900 | 120000 | 1383 | 2766 | 120000 | 1400000 | 1065 | 2130 | 99000 | 1300000 | 1284 | 2568 | 120000 | 1300000 |
| correct false | 8 | 8 | 3.50 | 170 | 423 | 423 | 3600 | 71000 | 422 | 422 | 8000 | 70000 | 259 | 259 | 4400 | 77000 | 54 | 54 | 4900 | 79000 | 146 | 146 | 6600 | 110000 | 280 | 280 | 8700 | 140000 | 3 | 3 | 210 | 2400 | 54 | 54 | 230 | 8800 | 0 | - | - | - | 206 | 206 | 8200 | 130000 | 189 | 189 | 1300 | 38000 | 0 | - | - | - | 294 | 294 | 8100 | 390000 | 216 | 216 | 6700 | 100000 | 0 | - | - | - | 420 | 420 | 13000 | 230000 | 137 | 137 | 18000 | 150000 | 8 | 8 | 240 | 3500 | 49 | 49 | 11000 | 100000 |
| correct-unconfirmed results | 23 | 0 | 21 | 930 | 209 | 0 | 760 | 12000 | 220 | 0 | 5700 | 21000 | 560 | 0 | 31000 | 880000 | 101 | 0 | 15000 | 220000 | 206 | 0 | 17000 | 260000 | 55 | 0 | 16000 | 34000 | 2 | 0 | 98 | 1600 | 269 | 0 | 17000 | 160000 | 5 | 0 | 4400 | 11000 | 159 | 0 | 14000 | 320000 | 241 | 0 | 540 | 39000 | 0 | - | - | - | 17 | 0 | 2300 | 43000 | 276 | 0 | 28000 | 360000 | 0 | - | - | - | 231 | 0 | 2300 | 15000 | 52 | 0 | 15000 | 90000 | 1 | 0 | 54 | 480 | 24 | 0 | 8700 | 61000 |
| correct-unconfirmed true | 2 | 0 | 11 | 180 | 199 | 0 | 530 | 9800 | 211 | 0 | 5300 | 19000 | 329 | 0 | 18000 | 390000 | 86 | 0 | 13000 | 200000 | 86 | 0 | 14000 | 190000 | 10 | 0 | 1500 | 18000 | 1 | 0 | 29 | 840 | 69 | 0 | 4500 | 22000 | 5 | 0 | 4400 | 11000 | 56 | 0 | 9300 | 240000 | 138 | 0 | 49 | 16000 | 0 | - | - | - | 10 | 0 | 2100 | 29000 | 105 | 0 | 24000 | 300000 | 0 | - | - | - | 207 | 0 | 2200 | 13000 | 3 | 0 | 540 | 5200 | 0 | - | - | - | 0 | - | - | - |
| correct-unconfirmed true | 21 | 0 | 10 | 740 | 10 | 0 | 230 | 2500 | 9 | 0 | 420 | 2500 | 231 | 0 | 13000 | 490000 | 15 | 0 | 1500 | 21000 | 120 | 0 | 3000 | 63000 | 45 | 0 | 15000 | 16000 | 1 | 0 | 69 | 800 | 200 | 0 | 12000 | 140000 | 0 | - | - | - | 103 | 0 | 4400 | 83000 | 103 | 0 | 490 | 23000 | 0 | - | - | - | 7 | 0 | 170 | 15000 | 171 | 0 | 3800 | 62000 | 0 | - | - | - | 24 | 0 | 61 | 1100 | 49 | 0 | 15000 | 85000 | 1 | 0 | 54 | 480 | 24 | 0 | 8700 | 61000 |
| incorrect results | 4 | -96 | 28 | 600 | 2 | -48 | 350 | 3600 | 3 | -80 | 150 | 610 | 373 | -6064 | 14000 | 570000 | 26 | -528 | 1600 | 48000 | 95 | -1632 | 3100 | 100000 | 0 | - | - | - | 1 | -32 | 29 | 700 | 43 | -1104 | 4500 | 57000 | 0 | - | - | - | 27 | -528 | 2100 | 32000 | 1781 | -30768 | 10000 | 440000 | 0 | - | - | - | 0 | - | - | - | 91 | -1664 | 4000 | 63000 | 0 | - | - | - | 1 | -32 | 2.40 | 75 | 2 | -64 | 400 | 4100 | 0 | - | - | - | 4 | -128 | 2500 | 12000 |
| incorrect true | 2 | -64 | 14 | 180 | 1 | -32 | 340 | 3600 | 2 | -64 | 140 | 530 | 6 | -192 | 170 | 7400 | 7 | -224 | 400 | 7000 | 7 | -224 | 450 | 9900 | 0 | - | - | - | 1 | -32 | 29 | 700 | 26 | -832 | 180 | 9900 | 0 | - | - | - | 6 | -192 | 200 | 3700 | 142 | -4544 | 430 | 26000 | 0 | - | - | - | 0 | - | - | - | 13 | -416 | 1800 | 21000 | 0 | - | - | - | 1 | -32 | 2.40 | 75 | 2 | -64 | 400 | 4100 | 0 | - | - | - | 4 | -128 | 2500 | 12000 |
| incorrect false | 2 | -32 | 14 | 410 | 1 | -16 | 4.90 | 59 | 1 | -16 | 9.30 | 79 | 367 | -5872 | 14000 | 560000 | 19 | -304 | 1200 | 41000 | 88 | -1408 | 2600 | 93000 | 0 | - | - | - | 0 | - | - | - | 17 | -272 | 4300 | 47000 | 0 | - | - | - | 21 | -336 | 1900 | 28000 | 1639 | -26224 | 9500 | 420000 | 0 | - | - | - | 0 | - | - | - | 78 | -1248 | 2200 | 41000 | 0 | - | - | - | 0 | - | - | - | 0 | - | - | - | 0 | - | - | - | 0 | - | - | - |
Detailed Results
Background is light blue for void tasks.
| 2LS 2024-11-29 11:00:37 CET | Bubaak 2024-11-29 13:23:21 CET | Bubaak-SpLit 2024-11-29 23:04:32 CET | CBMC 2024-12-09 14:22:17 CET | CPA-BAM-BnB 2024-12-09 15:02:47 CET | CPA-BAM-SMG 2024-12-09 17:24:44 CET | CPAchecker 2024-11-30 06:09:11 CET | DIVINE 2024-12-10 08:22:51 CET | ESBMC-kind 2024-12-02 10:54:34 CET | Goblint 2024-11-29 20:22:51 CET | Graves-CPA 2024-12-10 14:44:07 CET | Infer 2024-12-12 03:12:57 CET | Mopsa 2024-12-02 20:14:42 CET | Nacpa 2024-12-03 05:22:17 CET | PeSCo-CPA 2024-12-13 11:12:50 CET | SVF-SVC 2024-12-03 11:18:25 CET | Symbiotic 2024-12-01 13:17:06 CET | UAutomizer 2024-11-30 15:04:55 CET | UKojak 2024-12-05 21:20:14 CET | UTaipan 2024-12-05 21:21:41 CET | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|