bench/stutter: Update

* bench/stutter/stutter_invariance_randomgraph.cc: Update to recent
changes.  If an algorithm took more that 30s on an average for a set of
parameters, avoid running it with more states.  Take the density and
ap count as parameter.  Output all the algorithms on the same line.
Add additional statistics about automata.
* bench/stutter/stutter_invariance_formulas.cc: Update to recent
changes.  Output all the algorithms on the same line.
Add additional statistics about automata.
* bench/stutter/stutter_bench.sh: Use a Makefile to manage concurrency.
* bench/stutter/README: Update.
This commit is contained in:
Alexandre Duret-Lutz 2015-01-22 11:31:20 +01:00
parent 5d31094029
commit bd414d4d4c
4 changed files with 153 additions and 76 deletions

View file

@ -6,10 +6,12 @@ translation time is not included in the measured time.
To reproduce the benchmark is to run
% ./stutter_bench.sh
% ./stutter_bench.sh -j8
to create bench_formulas.csv and bench_randgraph.csv, and then
explore these data the provided ipython notbook
to create bench_formulas.csv and bench_randgraph.csv.
(Adjust -j8 to the number of cores you have.)
Then explore these data the provided ipython notebook
% ipython notebook --pylab=inline stutter.ipynb