Benchmark Setup

Benchmark COASTAL DASA GDart Java-Ranger JayHorn JBMC JDart JLiSA MLB SPF SWAT
Tool COASTAL Thu Nov 28 05:39:42 CET 2019 DASA 0.1 GDart gdart-0.1-871812c Java-Ranger 2025 JayHorn 0.9-floatingPoint JBMC 6.8.0 (cbmc-6.8.0-10-g4767cf5d65) JDart jdart-9aad16d JLiSA v0.2-ce67adbda MLB v3.0 SPF Tue Nov 26 21:45:09 CET 2019 SWAT 1
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4
Host apollon* apollon* apollon* apollon* apollon* apollon* apollon* apollon* apollon* apollon* apollon*
OS Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic Linux 6.8.0-88-generic
Selected date
Date of execution 2026-01-14 23:03:20 CET 2025-12-14 23:46:20 CET 2025-12-09 16:38:04 CET 2026-01-14 20:45:55 CET 2025-12-14 20:06:24 CET 2025-12-09 16:35:43 CET 2026-01-14 20:32:42 CET 2025-12-09 16:32:31 CET 2025-12-14 19:07:03 CET 2025-12-30 20:42:14 CET 2025-12-09 20:20:09 CET
Run set [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main] [SV-COMP26_Java.no-runtime-exception.Main; SV-COMP26_Java.valid-assert.Main]
Options

--graphml-witness witness.graphml

--graphml-witness witness.graphml

Statistics

COASTAL 2026-01-14 23:03:20 CET DASA 2025-12-14 23:46:20 CET GDart 2025-12-09 16:38:04 CET Java-Ranger 2026-01-14 20:45:55 CET JayHorn 2025-12-14 20:06:24 CET JBMC 2025-12-09 16:35:43 CET JDart 2026-01-14 20:32:42 CET JLiSA 2025-12-09 16:32:31 CET MLB 2025-12-14 19:07:03 CET SPF 2025-12-30 20:42:14 CET SWAT 2025-12-09 20:20:09 CET
Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB) Amount Raw score CPU (s) Mem (MB)
all results 1778 -14704 63000 270000 1778 239 490000 3000000 1778 1431 310000 1000000 1778 1096 95000 620000 1778 -2079 390000 3900000 1778 1413 170000 1800000 1778 -11100 110000 1400000 1778 1195 100000 1400000 1778 382 120000 540000 1778 -4264 85000 450000 1778 1295 97000 1000000
correct results 504 1008 3000 44000 239 239 99000 710000 920 1479 16000 320000 785 1288 42000 320000 414 689 33000 530000 1033 1845 5400 210000 530 1060 7300 210000 617 1195 7300 330000 423 494 6000 150000 372 744 3300 35000 863 1295 14000 210000
correct true 504 1008 3000 44000 0 - - - 559 1118 9800 190000 503 1006 38000 200000 275 550 11000 200000 812 1624 3900 150000 530 1060 7300 210000 578 1156 6900 310000 71 142 2400 34000 372 744 3300 35000 432 864 8800 110000
correct false 0 - - - 239 239 99000 710000 361 361 5900 130000 282 282 4200 120000 139 139 21000 330000 221 221 1500 63000 0 - - - 39 39 440 20000 352 352 3600 120000 0 - - - 431 431 4800 110000
correct-unconfirmed results 248 0 1400 22000 54 0 20000 160000 107 0 2600 40000 26 0 1200 8000 27 0 3900 72000 315 0 2200 74000 456 0 2800 150000 1 0 11 520 175 0 3400 81000 271 0 1200 23000 33 0 830 8600
correct-unconfirmed true 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - - 0 - - -
correct-unconfirmed true 248 0 1400 22000 54 0 20000 160000 107 0 2600 40000 26 0 1200 8000 27 0 3900 72000 315 0 2200 74000 456 0 2800 150000 1 0 11 520 175 0 3400 81000 271 0 1200 23000 33 0 830 8600
incorrect results 601 -15712 2700 53000 0 - - - 2 -48 51 900 11 -192 650 3000 167 -2768 25000 390000 14 -432 400 17000 557 -12160 3400 180000 0 - - - 4 -112 34 1400 279 -5008 1900 25000 0 - - -
incorrect true 381 -12192 1700 34000 0 - - - 1 -32 32 440 1 -32 10 510 6 -192 240 4300 13 -416 400 17000 203 -6496 1400 69000 0 - - - 3 -96 29 1100 34 -1088 540 3700 0 - - -
incorrect false 220 -3520 1000 20000 0 - - - 1 -16 19 460 10 -160 640 2500 161 -2576 24000 380000 1 -16 2.60 58 354 -5664 2100 110000 0 - - - 1 -16 4.40 310 245 -3920 1300 22000 0 - - -

Detailed Results

Background is light blue for void tasks.

COASTAL 2026-01-14 23:03:20 CET DASA 2025-12-14 23:46:20 CET GDart 2025-12-09 16:38:04 CET Java-Ranger 2026-01-14 20:45:55 CET JayHorn 2025-12-14 20:06:24 CET JBMC 2025-12-09 16:35:43 CET JDart 2026-01-14 20:32:42 CET JLiSA 2025-12-09 16:32:31 CET MLB 2025-12-14 19:07:03 CET SPF 2025-12-30 20:42:14 CET SWAT 2025-12-09 20:20:09 CET
Benchmark | Property | Expected result Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB) Status Raw score CPU (s) Mem (MB)
of 1
showing 0 of 0 tasks