CVS difference for acats/docs/ug-f.htm

Differences between 1.6 and version 1.7
Log of other versions for file acats/docs/ug-f.htm

--- acats/docs/ug-f.htm	2016/05/27 03:52:21	1.6
+++ acats/docs/ug-f.htm	2016/06/30 05:29:51	1.7
@@ -29,103 +29,110 @@
 <HR>
 <H1>Annex F<BR>
 Definitions</H1>
-<div class="Normal"><A NAME="I1058"></A><B>ACATS Modification List.</B> 
+<div class="Normal"><A NAME="I1059"></A><B>ACATS Modification List.</B> 
 (Abbreviated <B>AML</B>) A list maintained by the ACAA documenting the 
 currently modified and withdrawn tests. It also documents any new tests 
 that have been or will be added to the test suite. The ACATS modification 
 list is updated from time to time as challenges from implementers are 
 received and processed, new tests are created, or as other technical 
-information is received.<A NAME="I1059"></A></div>
-<div class="Normal"><A NAME="I1060"></A><B>Acceptable result.</B> The 
+information is received.<A NAME="I1060"></A></div>
+<div class="Normal"><A NAME="I1061"></A><B>Acceptable result.</B> The 
 result of processing an ACATS test program that meets the explicit grading 
 criteria for a grade of &quot;passed&quot; or inapplicable.</div>
-<div class="Normal"><A NAME="I1061"></A><B>ACVC Implementer's Guide.</B> 
+<div class="Normal"><A NAME="I1062"></A><B>ACVC Implementer's Guide.</B> 
 (Abbreviated <B>AIG</B>) A document describing the test objectives used 
 to produce test programs for <A HREF="UG-01.HTM#Ada83">[Ada83]</A> ACVC 
 versions (1.1-1.11). AIG section references are embedded in <A HREF="UG-01.HTM#Ada83">[Ada83]</A> 
-test naming conventions.<A NAME="I1062"></A></div>
-<div class="Normal"><A NAME="I1063"></A><B>Ada.</B> Short for <B>Ada 
+test naming conventions.<A NAME="I1063"></A></div>
+<div class="Normal"><A NAME="I1064"></A><B>Ada.</B> Short for <B>Ada 
 programming language</B>. The term Ada by itself always refers to the 
 most current ISO/IEC standard document(s); if a specific version of the 
 language standards is meant it will always be referred to explicitly 
 (for instance, as <A HREF="UG-01.HTM#Ada83">[Ada83]</A> or <A HREF="UG-01.HTM#Ada95">[Ada95]</A>).</div>
-<div class="Normal"><A NAME="I1064"></A><B>Ada Conformity Assessment 
+<div class="Normal"><A NAME="I1065"></A><B>Ada Conformity Assessment 
 Authority.</B> (Abbreviated <B>ACAA</B>) The part of the certification 
 body that provides technical guidance for operations of the Ada certification 
-system.<A NAME="I1065"></A></div>
-<div class="Normal"><A NAME="I1066"></A><B>Ada Conformity Assessment 
+system.<A NAME="I1066"></A></div>
+<div class="Normal"><A NAME="I1067"></A><B>Ada Conformity Assessment 
 Laboratory.</B> (Abbreviated <B>ACAL</B>) The part of the certification 
 body that carries out the procedures required to perform conformity assessment 
-of an Ada implementation. (Formerly AVF)<A NAME="I1067"></A></div>
-<div class="Normal"><A NAME="I1068"></A><B>Ada Conformity Assessment 
+of an Ada implementation. (Formerly AVF)<A NAME="I1068"></A></div>
+<div class="Normal"><A NAME="I1069"></A><B>Ada Conformity Assessment 
 Test Report.</B> (Abbreviated <B>ACATR</B>) A report summarizing the 
 results of formal ACATS testing. Test Reports are issued only after witness 
 testing is completed, and contain a summary of the testing (including 
 which Specialized Needs Annexes were tested, any test modifications needed, 
 and the values used in customizing the support files). Recent test reports 
 can be found on-line at <A HREF="http://www.ada-auth.org/cpl.html">http://www.ada-auth.org/cpl.html</A>, 
-linked from the Certified Processors List.<A NAME="I1069"></A></div>
-<div class="Normal"><A NAME="I1070"></A><B>Ada implementation.</B> An 
+linked from the Certified Processors List.<A NAME="I1070"></A></div>
+<div class="Normal"><A NAME="I1071"></A><B>Ada implementation.</B> An 
 Ada compilation system, including any required run-time support software, 
 together with its host  and target computer systems.</div>
-<div class="Normal"><A NAME="I1071"></A><B>Ada Joint Program Office.</B> 
+<div class="Normal"><A NAME="I1072"></A><B>Ada Joint Program Office.</B> 
 (Abbreviated <B>AJPO</B>) An organization within the U.S. Department 
 of Defense that sponsored the development of the ACVC and formerly provided 
-policy and guidance for an Ada certification system.<A NAME="I1072"></A></div>
-<div class="Normal"><A NAME="I1073"></A><B>Ada programming language.</B> 
+policy and guidance for an Ada certification system.<A NAME="I1073"></A></div>
+<div class="Normal"><A NAME="I1074"></A><B>Ada programming language.</B> 
 The language defined by the current Ada Standard documents.</div>
-<div class="Normal"><A NAME="I1074"></A><B>Ada Resource Association.</B> 
+<div class="Normal"><A NAME="I1075"></A><B>Ada Resource Association.</B> 
 (Abbreviated <B>ARA</B>) The trade association that sponsors the Ada 
-conformity assessment system.<A NAME="I1075"></A></div>
-<div class="Normal"><A NAME="I1076"></A><B>Ada Standard documents.</B> 
+conformity assessment system.<A NAME="I1076"></A></div>
+<div class="Normal"><A NAME="I1077"></A><B>Ada Standard documents.</B> 
 The document(s) that define the Ada programming language, currently the 
 Ada Standard <A HREF="UG-01.HTM#Ada2012">[Ada2012]</A> along with its 
 Technical Corrigendum <A HREF="UG-01.HTM#TC1-2012">[TC1-2012]</A> Future 
 corrigendum documents are also included (corrigenda fix bugs in a Standard). 
 </div>
-<div class="Normal"><A NAME="I1077"></A><B>Ada Validation Facility.</B> 
+<div class="Normal"><A NAME="I1078"></A><B>Ada Validation Facility.</B> 
 (Abbreviated <B>AVF</B>) Former designation of an Ada Conformity Assessment 
-Laboratory.<A NAME="I1078"></A></div>
-<div class="Normal"><A NAME="I1079"></A><B>Ada Validation Organization.</B> 
+Laboratory.<A NAME="I1079"></A></div>
+<div class="Normal"><A NAME="I1080"></A><B>Ada Validation Organization.</B> 
 (Abbreviated <B>AVO</B>) Organization that formerly performed the functions 
-of the Ada Conformity Assessment Authority.<A NAME="I1080"></A></div>
-<div class="Normal"><A NAME="I1081"></A><B>Certification Body.</B> The 
+of the Ada Conformity Assessment Authority.<A NAME="I1081"></A></div>
+<div class="Normal"><A NAME="I1082"></A><B>Certification Body.</B> The 
 organizations (ACAA and ACALs) collectively responsible for defining 
 and implementing Ada conformity assessments, including production and 
 maintenance of the ACATS tests, and award of Ada Conformity Assessment 
 Certificates.</div>
-<div class="Normal"><A NAME="I1082"></A><B>Certified Processors List.</B> 
+<div class="Normal"><A NAME="I1083"></A><B>Certified Processors List.</B> 
 (Abbreviated <B>CPL</B>) A published list identifying all certified Ada 
-implementations. The CPL is available on the ACAA Internet site (<A HREF="http://www.ada-auth.org">www.ada-auth.org</A>).<A NAME="I1083"></A></div>
-<div class="Normal"><A NAME="I1084"></A><B>Challenge.</B> A documented 
+implementations. The CPL is available on the ACAA Internet site (<A HREF="http://www.ada-auth.org">www.ada-auth.org</A>).<A NAME="I1084"></A></div>
+<div class="Normal"><A NAME="I1085"></A><B>Challenge.</B> A documented 
 disagreement with the test objective, test code, test grading criteria, 
 or result of processing an ACATS test program when the result is not 
 PASSED or INAPPLICABLE according to the established grading criteria. 
 A challenge is submitted to the ACAA.</div>
-<div class="Normal"><A NAME="I1085"></A><B>Conforming implementation.</B> 
+<div class="Normal"><A NAME="I1086"></A><B>Conforming implementation.</B> 
 An implementation that produces an acceptable result for every applicable 
 test. Any deviation constitutes a non-conformity.</div>
-<div class="Normal"><A NAME="I1086"></A><B>Core language.</B> Clauses 
+<div class="Normal"><A NAME="I1087"></A><B>Core language.</B> Clauses 
 2-13 and Annexes A, B, and J of <A HREF="UG-01.HTM#Ada95">[Ada95]</A>. 
 All implementations are required to implement the core language. The 
 tests for core language features are required of all implementations.</div>
-<div class="Normal"><A NAME="I1087"></A><B>Coverage documents.</B> Documents 
+<div class="Normal"><A NAME="I1088"></A><B>Coverage documents.</B> Documents 
 containing an analysis of every paragraph of the Ada Standard documents. 
 Each paragraph has an indication of whether it contains a testable Ada 
 requirement, and if so, suggested test objectives to cover the requirements 
 of the paragraphs. Paragraphs that include objectives also indicate what 
 ACATS test(s) specifically test those objectives.</div>
-<div class="Normal"><A NAME="I1088"></A><B>Deviation.</B> Failure of 
+<div class="Normal"><A NAME="I1089"></A><B>Deviation.</B> Failure of 
 an Ada implementation to produce an acceptable result when processing 
 an ACATS test program.</div>
-<div class="Normal"><A NAME="I1089"></A><B>Foundation Code.</B> Code 
+<div class="Normal"><A NAME="I1090"></A><B>Event Trace.</B> A list of 
+interesting events that occurs during the compilation, binding/linking, 
+and execution of one or more ACATS tests. An abstraction of the implementation-specific 
+details used by the grading tool.</div>
+<div class="Normal"><A NAME="I1091"></A><B>Foundation Code.</B> Code 
 used by multiple tests; foundation code is designed to be reusable. Generally 
 a foundation is a package containing types, variables, and subprograms 
 that are applicable and useful to a series of related tests. Foundation 
 code is never expected to cause compile time errors. It may be compiled 
 once for all tests that use it or recompiled for each test that uses 
 it; it must be bound with each test that uses it.</div>
-<div class="Normal"><A NAME="I1090"></A><B>Legacy Tests.</B> Tests that 
+<div class="Normal"><A NAME="I1092"></A><B>Grading Tool.</B> A tool to 
+automate grading of ACATS tests. Uses an event trace and test summary 
+to determine the pass or fail results of ACATS tests.</div>
+<div class="Normal"><A NAME="I1093"></A><B>Legacy Tests.</B> Tests that 
 were included in ACVC 1.12 that have been incorporated into later ACVC 
 and ACATS versions. The vast majority of these tests check for language 
 features that are upwardly compatible from <A HREF="UG-01.HTM#Ada83">[Ada83]</A> 
@@ -133,37 +140,44 @@
 the ACVC 1.12 versions to ensure that Ada rules are properly implemented 
 in cases where there were extensions or incompatibilities from <A HREF="UG-01.HTM#Ada83">[Ada83]</A> 
 to later versions of Ada.</div>
-<div class="Normal"><A NAME="I1091"></A><B>Modern Tests.</B> Tests that 
+<div class="Normal"><A NAME="I1094"></A><B>Modern Tests.</B> Tests that 
 have been constructed and added to the ACATS since the release of ACVC 
 1.12. These tests usually test features added to Ada since <A HREF="UG-01.HTM#Ada83">[Ada83]</A>. 
 Modern tests have a coding style more like that used by typical programmers 
 than the Legacy tests, and have a different naming convention.</div>
-<div class="Normal"><A NAME="I1092"></A><B>Specialized Needs Annex.</B> 
+<div class="Normal"><A NAME="I1095"></A><B>Range indicator.</B> A range 
+indicator provides detailed information about the expected location of 
+an error; tests using range indicators can be graded more accurately 
+by the grading tool.</div>
+<div class="Normal"><A NAME="I1096"></A><B>Specialized Needs Annex.</B> 
 (Abbreviated <B>SNA</B>) One of annexes C through H of <A HREF="UG-01.HTM#Ada95">[Ada95]</A>. 
 Conformity testing against one or more Specialized Needs Annexes is optional. 
 There are tests that apply to each of the Specialized Needs Annexes. 
 Results of processing these tests (if processed during a conformity assessment) 
-are reported on the certificate and in the Certified Processors List.<A NAME="I1093"></A></div>
-<div class="Normal"><A NAME="I1094"></A><B>Test Objective.</B> The intended 
+are reported on the certificate and in the Certified Processors List.<A NAME="I1097"></A></div>
+<div class="Normal"><A NAME="I1098"></A><B>Test Objective.</B> The intended 
 purpose of an ACATS test. A test objective ought to be relatable to rules 
 given in the Standards that define Ada.</div>
-<div class="Normal"><A NAME="I1095"></A><B>Test Objectives Document.</B> 
+<div class="Normal"><A NAME="I1099"></A><B>Test Objectives Document.</B> 
 A document containing the test objectives used for Modern ACATS tests. 
 Information on Legacy tests is not included.</div>
-<div class="Normal"><A NAME="I1096"></A><B>Validated Compilers List.</B> 
+<div class="Normal"><A NAME="I1100"></A><B>Test Summary.</B> A list of 
+information about one or more ACATS tests, describing the test requirements 
+to the grading tool.</div>
+<div class="Normal"><A NAME="I1101"></A><B>Validated Compilers List.</B> 
 (Abbreviated <B>VCL</B>) Former designation of the Certified Processors 
-List.<A NAME="I1097"></A></div>
-<div class="Normal"><A NAME="I1098"></A><B>Validated Implementation.</B> 
+List.<A NAME="I1102"></A></div>
+<div class="Normal"><A NAME="I1103"></A><B>Validated Implementation.</B> 
 Informally used to mean Conforming Implementation.</div>
-<div class="Normal"><A NAME="I1099"></A><B>Validation.</B>  Informally 
+<div class="Normal"><A NAME="I1104"></A><B>Validation.</B>  Informally 
 used to mean conformity assessment.</div>
-<div class="Normal"><A NAME="I1100"></A><B>Withdrawn Test.</B> A test 
+<div class="Normal"><A NAME="I1105"></A><B>Withdrawn Test.</B> A test 
 found to be incorrect and not used in conformity testing. A test may 
 be incorrect because it has an invalid test objective, fails to meet 
 its test objective, or contains erroneous or illegal use of the Ada programming 
 language. Withdrawn tests are not applicable to any implementation. Withdrawn 
 tests are often modified and restored to subsequent ACATS releases.</div>
-<div class="Normal"><A NAME="I1101"></A><B>Witness Testing.</B> Conformity 
+<div class="Normal"><A NAME="I1106"></A><B>Witness Testing.</B> Conformity 
 assessment testing performed in the presence of ACAL personnel. Witness 
 testing adds the assurance that the test procedures were followed and 
 that the results were verified.</div>

Questions? Ask the ACAA Technical Agent