alarsyo/spot
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

ltlcross, autcross, ltldo: support --fail-on-timeout

Browse source 
Suggested by Tobias Meggendorfer.  Fixes #294.

* bin/autcross.cc, bin/ltlcross.cc, bin/ltldo.cc: Add the option.
* tests/core/autcross3.test, tests/core/ltlcross3.test,
tests/core/ltldo.test: Test it.
* tests/Makefile.am: Add autcross3.test.
* NEWS, doc/org/autcross.org, doc/org/ltlcross.org, doc/org/ltldo.org:
Mention the option.
* THANKS: Add Tobias.
This commit is contained in:
Alexandre Duret-Lutz 2017-10-15 10:44:26 +02:00
parent 0a2bca1377
commit 183ec1fb4e
12 changed files with 147 additions and 21 deletions
Download patch file Download diff file Expand all files Collapse all files

6
doc/org/autcross.org
View file

@ -319,7 +319,7 @@ Incoherence between the output of several tools (even with
The =--stop-on-error= option will cause =autcross= to abort on the
first detected error. This include failure to start some tool,
read its output, or failure to passe the sanity checks. Timeouts are
allowed.
allowed unless =--fail-on-timeout= is also given.
One use for this option is when =autcross= is used in combination with
=randaut= to check tools on an infinite stream of formulas.
@ -329,8 +329,8 @@ One use for this option is when =autcross= is used in combination with
The =--save-bogus=FILENAME= will save any automaton for which an error
was detected (either some tool failed, or some problem was
detected using the resulting automata) in =FILENAME=. Again, timeouts
are not considered to be errors, and therefore not reported in this
file.
are not considered to be errors and therefore not reported in this
file, unless =--fail-on-timeout= is given.
The main use for this feature is in conjunction with =randaut='s
generation of random formulas. For instance the following command

6
doc/org/ltlcross.org
View file

@ -733,7 +733,7 @@ automaton as well.
The =--stop-on-error= option will cause =ltlcross= to abort on the
first detected error. This include failure to start some translator,
read its output, or failure to passe the sanity checks. Timeouts are
allowed.
allowed unless =--fail-on-time= is also given.
One use for this option is when =ltlcross= is used in combination with
=randltl= to check translators on an infinite stream of formulas.
@ -752,8 +752,8 @@ randltl -n -1 --tree-size 10..25 a b c | ltlcross --stop-on-error 'ltl2tgba --lb
The =--save-bogus=FILENAME= will save any formula for which an error
was detected (either some translation failed, or some problem was
detected using the resulting automata) in =FILENAME=. Again, timeouts
are not considered to be errors, and therefore not reported in this
file.
are not considered to be errors and therefore not reported in this
file, unless =--fail-on-timeout= is given.
The main use for this feature is in conjunction with =randltl='s
generation of random formulas. For instance the following command

4
doc/org/ltldo.org
View file

@ -626,7 +626,9 @@ When a timeout occurs a warning is printed on stderr, and no automaton
(or statistic) is output by =ltdo= for this specific pair of
command/formula. The processing then continue with other formulas and
tools. Timeouts are not considered as errors, so they have no effect
on the exit status of =ltldo=.
on the exit status of =ltldo=. This behavior can be changed with
option =--fail-on-timeout=, in which case timeouts are considered
as errors.
For each command (that does not terminate with a timeout) the runtime
can be printed using the =%r= escape sequence. This makes =ltldo= an