Benchmark Setup

Benchmark COASTAL GDart Java-Ranger JayHorn JBMC JDart MLB SPF SWAT
Tool COASTAL Thu Nov 28 05:39:42 CET 2019 GDart gdart-0.1-c7eee29 Java-Ranger 2025 JayHorn 0.9-violationWitness JBMC 6.3.1 (cbmc-6.3.1-17-gee6f6fac3f) JDart jdart-9aad16d MLB v2.0 SPF Tue Nov 26 21:45:09 CET 2019 SWAT 1
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4
Host apollon* apollon* apollon* apollon* apollon* apollon* apollon* apollon* apollon*
OS Linux 6.8.0-50-generic Linux 6.8.0-49-generic Linux 6.8.0-49-generic Linux 6.8.0-50-generic Linux 6.8.0-49-generic Linux 6.8.0-50-generic Linux 6.8.0-49-generic Linux 6.8.0-51-generic Linux 6.8.0-49-generic
Selected date
Date of execution 2024-12-12 02:57:14 CET 2024-12-05 09:57:26 CET 2024-12-05 10:28:00 CET 2024-12-12 02:41:19 CET 2024-12-05 11:32:28 CET 2024-12-12 02:41:19 CET 2024-12-05 11:34:17 CET 2024-12-20 17:46:54 CET 2024-12-05 12:03:04 CET
Run set SV-COMP25_assert_java.ReachSafety-Java [SV-COMP25_assert_java.ReachSafety-Java; SV-COMP25_runtime-exception.RuntimeException-Java] [SV-COMP25_assert_java.ReachSafety-Java; SV-COMP25_runtime-exception.RuntimeException-Java] SV-COMP25_assert_java.ReachSafety-Java [SV-COMP25_assert_java.ReachSafety-Java; SV-COMP25_runtime-exception.RuntimeException-Java] SV-COMP25_assert_java.ReachSafety-Java SV-COMP25_assert_java.ReachSafety-Java [SV-COMP25_assert_java.ReachSafety-Java; SV-COMP25_runtime-exception.RuntimeException-Java] SV-COMP25_assert_java.ReachSafety-Java
Options

--graphml-witness witness.graphml

--graphml-witness witness.graphml

Statistics

COASTAL 2024-12-12 02:57:14 CET GDart 2024-12-05 09:57:26 CET Java-Ranger 2024-12-05 10:28:00 CET JayHorn 2024-12-12 02:41:19 CET JBMC 2024-12-05 11:32:28 CET JDart 2024-12-12 02:41:19 CET MLB 2024-12-05 11:34:17 CET SPF 2024-12-20 17:46:54 CET SWAT 2024-12-05 12:03:04 CET
Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB)
all results 674 -3960 26000 110000 1347 1354 180000 1600000 1347 1059 81000 520000 674 248 150000 1600000 1347 1600 97000 1300000 674 -1224 46000 580000 674 579 66000 410000 1347 -3370 83000 400000 674 508 29000 170000
correct results 180 360 1100 15000 826 1354 14000 380000 715 1155 40000 290000 241 376 15000 280000 998 1760 3800 67000 204 408 2900 76000 517 707 6100 190000 315 630 3200 31000 345 508 5000 83000
correct true 180 360 1100 15000 528 1056 9500 250000 440 880 36000 160000 135 270 6800 120000 762 1524 3100 50000 204 408 2900 76000 190 380 3000 80000 315 630 3200 31000 163 326 3300 39000
correct false 0 - - - 298 298 4800 140000 275 275 4300 120000 106 106 8200 160000 236 236 680 17000 0 - - - 327 327 3100 110000 0 - - - 182 182 1700 44000
correct-unconfirmed results 225 0 1200 21000 20 0 410 11000 17 0 370 6200 47 0 11000 220000 100 0 1200 23000 352 0 2000 120000 63 0 1100 34000 256 0 1200 23000 102 0 1700 27000
correct-unconfirmed true 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - -
correct-unconfirmed true 225 0 1200 21000 20 0 410 11000 17 0 370 6200 47 0 11000 220000 100 0 1200 23000 352 0 2000 120000 63 0 1100 34000 256 0 1200 23000 102 0 1700 27000
incorrect results 135 -4320 1500 16000 0 - - - 5 -96 710 2400 4 -128 180 4400 9 -160 57 3000 51 -1632 320 19000 4 -128 230 3600 247 -4000 1800 24000 0 - - -
incorrect true 135 -4320 1500 16000 0 - - - 1 -32 11 510 4 -128 180 4400 1 -32 1.90 37 51 -1632 320 19000 4 -128 230 3600 3 -96 480 1400 0 - - -
incorrect false 0 - - - 0 - - - 4 -64 700 1900 0 - - - 8 -128 55 3000 0 - - - 0 - - - 244 -3904 1300 22000 0 - - -

Detailed Results

Background is light blue for void tasks.

COASTAL 2024-12-12 02:57:14 CET GDart 2024-12-05 09:57:26 CET Java-Ranger 2024-12-05 10:28:00 CET JayHorn 2024-12-12 02:41:19 CET JBMC 2024-12-05 11:32:28 CET JDart 2024-12-12 02:41:19 CET MLB 2024-12-05 11:34:17 CET SPF 2024-12-20 17:46:54 CET SWAT 2024-12-05 12:03:04 CET
Benchmark | Property | Expected result Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB)
of 1
showing 0 of 0 tasks