spot/bench/stutter
Alexandre Duret-Lutz e900488e13 bench/stutter: add a "user" benchmark
* bench/stutter/user.sh: New bench.
* bench/stutter/Makefile.am: Add it.
* bench/stutter/README: Mention it.
* bench/stutter/stutter_bench.sh: Run it.
2015-02-13 16:58:42 +01:00
..
Makefile.am bench/stutter: add a "user" benchmark 2015-02-13 16:58:42 +01:00
README bench/stutter: add a "user" benchmark 2015-02-13 16:58:42 +01:00
stutter.ipynb stutter: fiddle with the benchmark 2014-11-26 10:38:32 +01:00
stutter_bench.sh bench/stutter: add a "user" benchmark 2015-02-13 16:58:42 +01:00
stutter_invariance_formulas.cc bench/stutter: Update 2015-02-11 11:39:43 +01:00
stutter_invariance_randomgraph.cc bench/stutter: Update 2015-02-11 11:39:43 +01:00
user.sh bench/stutter: add a "user" benchmark 2015-02-13 16:58:42 +01:00

This benchmark measures the performance of different algorithms to
check if a property is stutter-invariant.  When the benchmark is run
on formulas, the translation time is not included in the measured
time.

To reproduce the benchmark run

  % ./stutter_bench.sh -j8

(Adjust -j8 to the number of cores you have.)

This should create three files:

  - bench_formulas.csv
      running stutter checks on LTL formulas, but without including
      LTL translation time.
  - bench_randgraph.csv
      unning stutter checks on deterministic TGBA, without including
      complementation time.
  - ltl-user-bench.csv
      running stutter checks on LTL formulas, from the user point
      of view, i.e., timing the whole "ltlfilt" run.