spot/bench/stutter
Alexandre Duret-Lutz 6ded5e75c4 merge ltlvisit/ ltlast/ ltlenv/ into a single tl/ directory
The ltl prefix does not make a lot of sens anymore (since we
support psl as well).  ltlast/ and ltlenv/ were almost empty.
And ltlvisit/ did not contain any visitor anymore.

* src/ltlvisit/, src/ltlast/, src/ltlenv/: Merge into...
* src/tl/: ...this.
* NEWS: Mention the change.
* README, bench/stutter/stutter_invariance_formulas.cc,
bench/stutter/stutter_invariance_randomgraph.cc, configure.ac,
doc/org/tut01.org, doc/org/tut02.org, doc/org/tut10.org, doc/tl/tl.tex,
iface/ltsmin/ltsmin.hh, iface/ltsmin/modelcheck.cc, src/Makefile.am,
src/bin/autfilt.cc, src/bin/common_output.cc, src/bin/common_output.hh,
src/bin/common_r.hh, src/bin/common_trans.cc, src/bin/genltl.cc,
src/bin/ltl2tgba.cc, src/bin/ltl2tgta.cc, src/bin/ltlcross.cc,
src/bin/ltldo.cc, src/bin/ltlfilt.cc, src/bin/ltlgrind.cc,
src/bin/randltl.cc, src/kripke/kripkeexplicit.hh,
src/kripkeparse/public.hh, src/parseaut/public.hh, src/priv/accmap.hh,
src/ta/taexplicit.hh, src/ta/tgtaexplicit.hh, src/tests/equalsf.cc,
src/tests/ikwiad.cc, src/tests/length.cc, src/tests/ltlrel.cc,
src/tests/randtgba.cc, src/tests/readltl.cc, src/tests/reduc.cc,
src/tests/syntimpl.cc, src/tests/taatgba.cc, src/tests/tostring.cc,
src/tests/twagraph.cc, src/twa/acc.hh, src/twa/bdddict.cc,
src/twa/bdddict.hh, src/twa/bddprint.cc, src/twa/taatgba.cc,
src/twa/taatgba.hh, src/twa/twa.hh, src/twa/twagraph.cc,
src/twa/twagraph.hh, src/twa/twasafracomplement.cc,
src/twaalgos/compsusp.cc, src/twaalgos/compsusp.hh,
src/twaalgos/dtgbasat.cc, src/twaalgos/hoa.cc,
src/twaalgos/isweakscc.cc, src/twaalgos/lbtt.cc,
src/twaalgos/ltl2taa.cc, src/twaalgos/ltl2taa.hh,
src/twaalgos/ltl2tgba_fm.cc, src/twaalgos/ltl2tgba_fm.hh,
src/twaalgos/minimize.hh, src/twaalgos/neverclaim.cc,
src/twaalgos/randomgraph.hh, src/twaalgos/relabel.hh,
src/twaalgos/remprop.hh, src/twaalgos/stats.cc, src/twaalgos/stutter.cc,
src/twaalgos/translate.hh, wrap/python/spot_impl.i,
src/ltlparse/ltlparse.yy, src/ltlparse/public.hh: Adjust.
2015-09-28 15:36:48 +02:00
..
.gitignore More files to ignore 2015-02-26 17:30:02 +01:00
Makefile.am bench/stutter: add a "user" benchmark 2015-02-13 16:58:42 +01:00
README bench/stutter: add a "user" benchmark 2015-02-13 16:58:42 +01:00
stutter.ipynb stutter: fiddle with the benchmark 2014-11-26 10:38:32 +01:00
stutter_bench.sh bench/stutter: add a "user" benchmark 2015-02-13 16:58:42 +01:00
stutter_invariance_formulas.cc merge ltlvisit/ ltlast/ ltlenv/ into a single tl/ directory 2015-09-28 15:36:48 +02:00
stutter_invariance_randomgraph.cc merge ltlvisit/ ltlast/ ltlenv/ into a single tl/ directory 2015-09-28 15:36:48 +02:00
user.sh stutter: new variant of Etessami's check 2015-04-17 15:18:47 +02:00

This benchmark measures the performance of different algorithms to
check if a property is stutter-invariant.  When the benchmark is run
on formulas, the translation time is not included in the measured
time.

To reproduce the benchmark run

  % ./stutter_bench.sh -j8

(Adjust -j8 to the number of cores you have.)

This should create three files:

  - bench_formulas.csv
      running stutter checks on LTL formulas, but without including
      LTL translation time.
  - bench_randgraph.csv
      unning stutter checks on deterministic TGBA, without including
      complementation time.
  - ltl-user-bench.csv
      running stutter checks on LTL formulas, from the user point
      of view, i.e., timing the whole "ltlfilt" run.