6.1.4 Grading Tool Reference

The name of an event trace file (see 6.2). This can use any file name acceptable to the implementation that compiled the tool (in particular, full paths may be used on most implementations). The event trace should contain traces of the processing of at least the tests to be graded; it is acceptable to include traces for additional tests that are not being graded.

The name of a test summary file (see 6.3). This can use any file name acceptable to the implementation that compiled the tool (in particular, full paths may be used on most implementations). The test summary file should contain the summaries of exactly the tests that need to be graded; all of the tests summarized in the file will be graded regardless of the contents of the event trace. If the event trace does not include a test that is in the summary file, the test will be graded "Failed - Compile Missing".

The name of a manual grading request file (see 6.4). This can use any file name acceptable to the implementation that compiled the tool (in particular, full paths may be used on most implementations). This file may include names of tests not included in the test summary file; such names will have no effect on grading.

A double quoted string containing the name of the test report. This is primarily intended so that similar-looking reports can be differentiated.

Zero or more optional setting flags for the Grading Tool. These are case-insensitive, and can be: 

Compiling of specifications is optional. Use for source-based compilers (such as the commonly used GNAT compiler) that don't compile specifications in normal operation. Compilation of bodies, instances, and so on are checked.

All compilations are checked and must be present (unless processing the unit is marked as optional). This is the default.

No compilation checks are made. This option is not allowed for formal conformity assessments.

Check event trace time stamp information as part of checking, specifically, enforce that all units of a test are compiled and run in an appropriate order and reasonably close in time. This is the default.

Do not make any check of event trace time stamps. Use this option only if there is no meaningful timestamps in the event trace. This option is not allowed for formal conformity assessments.

Use position information when checking whether errors are appropriately detected. This is the default.

Use only line information when checking whether errors are appropriately detected. Use this option if the event trace doesn't have position information. It is acceptable to use this option for formal conformity assessments.

Produce minimal information: a list of failed tests and the summary report.

Produce information about every test processed (including passed tests), along with the summary report. In this mode, the grading tool also produces a warning for multiple messages for one error tag.

Produce details about each failed test, along with the summary report. This is the default.