Home My Page Projects Code Snippets Project Openings diderot
Summary Activity Tracker Tasks SCM

SCM Repository

[diderot] Annotation of /tests/rtest/README
ViewVC logotype

Annotation of /tests/rtest/README

Parent Directory Parent Directory | Revision Log Revision Log


Revision 5223 - (view) (download)

1 : glk 4640 These are regression tests for the Diderot compiler. Each test lives in its
2 :     own directory under rtest/tests, data files live in the rtest/data directory.
3 :    
4 :     Tests live in the "tests" subdirectory. For a test named "foo", we should have
5 :    
6 :     tests/foo -- the test directory
7 :     tests/foo/foo.diderot -- the test source code
8 :     tests/foo/assess.sh -- an assessment script that should either return a
9 :     numeric result representing the difference, or one
10 : jhr 5223 of "ok" or "fail". This script is given the
11 :     '--double' flag if it was specified as one of the
12 :     diderotc flags.
13 : glk 4640 tests/foo/correct.{nrrd,txt} -- the correct output. Usually a nrrd file, but
14 :     some tests produce textual output
15 : jhr 5223 tests/Makefile -- optional makefile for building the application
16 : glk 4640 tests/foo/run.sh -- optional script for running the application
17 :    
18 :     By convention, tests should produce a file "out.nrrd". If they also produce textual
19 :     output that needs assessment, then a "run.sh" script should be provided that redirects
20 :     the output to a file "out.txt".
21 :    
22 :     The assess.sh file should usually produce a numeric result representing the difference
23 :     between the correct output ("correct.nrrd") and the output from the test ("out.nrrd").
24 :     In some cases, assess.sh can produce the output "ok" or "fail", when a numeric result
25 :     does not make sense.
26 :    
27 :     To run all of the tests, use the command scripts/run.sh. It has the following
28 :     usage:
29 :    
30 :     scripts/run.sh [diderotc] [diderotc-flags] [-- runtime-flags]
31 :    
32 :     As it runs, it writes progress information to standard out. It also produces
33 :     two files. A reprt file that summarizes the results and a log file that contains
34 :     any output from running the compiler or program (e.g., error messages).
35 :    
36 :     To run a single test, use the command scripts/run-one.sh, which has the
37 :     following usage:
38 :    
39 :     scripts/run-one.sh test [diderotc] [diderotc-flags]

root@smlnj-gforge.cs.uchicago.edu
ViewVC Help
Powered by ViewVC 1.0.0