CVS difference for acats/docs/ug-f.htm
--- acats/docs/ug-f.htm 2016/05/27 03:52:21 1.6
+++ acats/docs/ug-f.htm 2016/06/30 05:29:51 1.7
@@ -29,103 +29,110 @@
<HR>
<H1>Annex F<BR>
Definitions</H1>
-<div class="Normal"><A NAME="I1058"></A><B>ACATS Modification List.</B>
+<div class="Normal"><A NAME="I1059"></A><B>ACATS Modification List.</B>
(Abbreviated <B>AML</B>) A list maintained by the ACAA documenting the
currently modified and withdrawn tests. It also documents any new tests
that have been or will be added to the test suite. The ACATS modification
list is updated from time to time as challenges from implementers are
received and processed, new tests are created, or as other technical
-information is received.<A NAME="I1059"></A></div>
-<div class="Normal"><A NAME="I1060"></A><B>Acceptable result.</B> The
+information is received.<A NAME="I1060"></A></div>
+<div class="Normal"><A NAME="I1061"></A><B>Acceptable result.</B> The
result of processing an ACATS test program that meets the explicit grading
criteria for a grade of "passed" or inapplicable.</div>
-<div class="Normal"><A NAME="I1061"></A><B>ACVC Implementer's Guide.</B>
+<div class="Normal"><A NAME="I1062"></A><B>ACVC Implementer's Guide.</B>
(Abbreviated <B>AIG</B>) A document describing the test objectives used
to produce test programs for <A HREF="UG-01.HTM#Ada83">[Ada83]</A> ACVC
versions (1.1-1.11). AIG section references are embedded in <A HREF="UG-01.HTM#Ada83">[Ada83]</A>
-test naming conventions.<A NAME="I1062"></A></div>
-<div class="Normal"><A NAME="I1063"></A><B>Ada.</B> Short for <B>Ada
+test naming conventions.<A NAME="I1063"></A></div>
+<div class="Normal"><A NAME="I1064"></A><B>Ada.</B> Short for <B>Ada
programming language</B>. The term Ada by itself always refers to the
most current ISO/IEC standard document(s); if a specific version of the
language standards is meant it will always be referred to explicitly
(for instance, as <A HREF="UG-01.HTM#Ada83">[Ada83]</A> or <A HREF="UG-01.HTM#Ada95">[Ada95]</A>).</div>
-<div class="Normal"><A NAME="I1064"></A><B>Ada Conformity Assessment
+<div class="Normal"><A NAME="I1065"></A><B>Ada Conformity Assessment
Authority.</B> (Abbreviated <B>ACAA</B>) The part of the certification
body that provides technical guidance for operations of the Ada certification
-system.<A NAME="I1065"></A></div>
-<div class="Normal"><A NAME="I1066"></A><B>Ada Conformity Assessment
+system.<A NAME="I1066"></A></div>
+<div class="Normal"><A NAME="I1067"></A><B>Ada Conformity Assessment
Laboratory.</B> (Abbreviated <B>ACAL</B>) The part of the certification
body that carries out the procedures required to perform conformity assessment
-of an Ada implementation. (Formerly AVF)<A NAME="I1067"></A></div>
-<div class="Normal"><A NAME="I1068"></A><B>Ada Conformity Assessment
+of an Ada implementation. (Formerly AVF)<A NAME="I1068"></A></div>
+<div class="Normal"><A NAME="I1069"></A><B>Ada Conformity Assessment
Test Report.</B> (Abbreviated <B>ACATR</B>) A report summarizing the
results of formal ACATS testing. Test Reports are issued only after witness
testing is completed, and contain a summary of the testing (including
which Specialized Needs Annexes were tested, any test modifications needed,
and the values used in customizing the support files). Recent test reports
can be found on-line at <A HREF="http://www.ada-auth.org/cpl.html">http://www.ada-auth.org/cpl.html</A>,
-linked from the Certified Processors List.<A NAME="I1069"></A></div>
-<div class="Normal"><A NAME="I1070"></A><B>Ada implementation.</B> An
+linked from the Certified Processors List.<A NAME="I1070"></A></div>
+<div class="Normal"><A NAME="I1071"></A><B>Ada implementation.</B> An
Ada compilation system, including any required run-time support software,
together with its host and target computer systems.</div>
-<div class="Normal"><A NAME="I1071"></A><B>Ada Joint Program Office.</B>
+<div class="Normal"><A NAME="I1072"></A><B>Ada Joint Program Office.</B>
(Abbreviated <B>AJPO</B>) An organization within the U.S. Department
of Defense that sponsored the development of the ACVC and formerly provided
-policy and guidance for an Ada certification system.<A NAME="I1072"></A></div>
-<div class="Normal"><A NAME="I1073"></A><B>Ada programming language.</B>
+policy and guidance for an Ada certification system.<A NAME="I1073"></A></div>
+<div class="Normal"><A NAME="I1074"></A><B>Ada programming language.</B>
The language defined by the current Ada Standard documents.</div>
-<div class="Normal"><A NAME="I1074"></A><B>Ada Resource Association.</B>
+<div class="Normal"><A NAME="I1075"></A><B>Ada Resource Association.</B>
(Abbreviated <B>ARA</B>) The trade association that sponsors the Ada
-conformity assessment system.<A NAME="I1075"></A></div>
-<div class="Normal"><A NAME="I1076"></A><B>Ada Standard documents.</B>
+conformity assessment system.<A NAME="I1076"></A></div>
+<div class="Normal"><A NAME="I1077"></A><B>Ada Standard documents.</B>
The document(s) that define the Ada programming language, currently the
Ada Standard <A HREF="UG-01.HTM#Ada2012">[Ada2012]</A> along with its
Technical Corrigendum <A HREF="UG-01.HTM#TC1-2012">[TC1-2012]</A> Future
corrigendum documents are also included (corrigenda fix bugs in a Standard).
</div>
-<div class="Normal"><A NAME="I1077"></A><B>Ada Validation Facility.</B>
+<div class="Normal"><A NAME="I1078"></A><B>Ada Validation Facility.</B>
(Abbreviated <B>AVF</B>) Former designation of an Ada Conformity Assessment
-Laboratory.<A NAME="I1078"></A></div>
-<div class="Normal"><A NAME="I1079"></A><B>Ada Validation Organization.</B>
+Laboratory.<A NAME="I1079"></A></div>
+<div class="Normal"><A NAME="I1080"></A><B>Ada Validation Organization.</B>
(Abbreviated <B>AVO</B>) Organization that formerly performed the functions
-of the Ada Conformity Assessment Authority.<A NAME="I1080"></A></div>
-<div class="Normal"><A NAME="I1081"></A><B>Certification Body.</B> The
+of the Ada Conformity Assessment Authority.<A NAME="I1081"></A></div>
+<div class="Normal"><A NAME="I1082"></A><B>Certification Body.</B> The
organizations (ACAA and ACALs) collectively responsible for defining
and implementing Ada conformity assessments, including production and
maintenance of the ACATS tests, and award of Ada Conformity Assessment
Certificates.</div>
-<div class="Normal"><A NAME="I1082"></A><B>Certified Processors List.</B>
+<div class="Normal"><A NAME="I1083"></A><B>Certified Processors List.</B>
(Abbreviated <B>CPL</B>) A published list identifying all certified Ada
-implementations. The CPL is available on the ACAA Internet site (<A HREF="http://www.ada-auth.org">www.ada-auth.org</A>).<A NAME="I1083"></A></div>
-<div class="Normal"><A NAME="I1084"></A><B>Challenge.</B> A documented
+implementations. The CPL is available on the ACAA Internet site (<A HREF="http://www.ada-auth.org">www.ada-auth.org</A>).<A NAME="I1084"></A></div>
+<div class="Normal"><A NAME="I1085"></A><B>Challenge.</B> A documented
disagreement with the test objective, test code, test grading criteria,
or result of processing an ACATS test program when the result is not
PASSED or INAPPLICABLE according to the established grading criteria.
A challenge is submitted to the ACAA.</div>
-<div class="Normal"><A NAME="I1085"></A><B>Conforming implementation.</B>
+<div class="Normal"><A NAME="I1086"></A><B>Conforming implementation.</B>
An implementation that produces an acceptable result for every applicable
test. Any deviation constitutes a non-conformity.</div>
-<div class="Normal"><A NAME="I1086"></A><B>Core language.</B> Clauses
+<div class="Normal"><A NAME="I1087"></A><B>Core language.</B> Clauses
2-13 and Annexes A, B, and J of <A HREF="UG-01.HTM#Ada95">[Ada95]</A>.
All implementations are required to implement the core language. The
tests for core language features are required of all implementations.</div>
-<div class="Normal"><A NAME="I1087"></A><B>Coverage documents.</B> Documents
+<div class="Normal"><A NAME="I1088"></A><B>Coverage documents.</B> Documents
containing an analysis of every paragraph of the Ada Standard documents.
Each paragraph has an indication of whether it contains a testable Ada
requirement, and if so, suggested test objectives to cover the requirements
of the paragraphs. Paragraphs that include objectives also indicate what
ACATS test(s) specifically test those objectives.</div>
-<div class="Normal"><A NAME="I1088"></A><B>Deviation.</B> Failure of
+<div class="Normal"><A NAME="I1089"></A><B>Deviation.</B> Failure of
an Ada implementation to produce an acceptable result when processing
an ACATS test program.</div>
-<div class="Normal"><A NAME="I1089"></A><B>Foundation Code.</B> Code
+<div class="Normal"><A NAME="I1090"></A><B>Event Trace.</B> A list of
+interesting events that occurs during the compilation, binding/linking,
+and execution of one or more ACATS tests. An abstraction of the implementation-specific
+details used by the grading tool.</div>
+<div class="Normal"><A NAME="I1091"></A><B>Foundation Code.</B> Code
used by multiple tests; foundation code is designed to be reusable. Generally
a foundation is a package containing types, variables, and subprograms
that are applicable and useful to a series of related tests. Foundation
code is never expected to cause compile time errors. It may be compiled
once for all tests that use it or recompiled for each test that uses
it; it must be bound with each test that uses it.</div>
-<div class="Normal"><A NAME="I1090"></A><B>Legacy Tests.</B> Tests that
+<div class="Normal"><A NAME="I1092"></A><B>Grading Tool.</B> A tool to
+automate grading of ACATS tests. Uses an event trace and test summary
+to determine the pass or fail results of ACATS tests.</div>
+<div class="Normal"><A NAME="I1093"></A><B>Legacy Tests.</B> Tests that
were included in ACVC 1.12 that have been incorporated into later ACVC
and ACATS versions. The vast majority of these tests check for language
features that are upwardly compatible from <A HREF="UG-01.HTM#Ada83">[Ada83]</A>
@@ -133,37 +140,44 @@
the ACVC 1.12 versions to ensure that Ada rules are properly implemented
in cases where there were extensions or incompatibilities from <A HREF="UG-01.HTM#Ada83">[Ada83]</A>
to later versions of Ada.</div>
-<div class="Normal"><A NAME="I1091"></A><B>Modern Tests.</B> Tests that
+<div class="Normal"><A NAME="I1094"></A><B>Modern Tests.</B> Tests that
have been constructed and added to the ACATS since the release of ACVC
1.12. These tests usually test features added to Ada since <A HREF="UG-01.HTM#Ada83">[Ada83]</A>.
Modern tests have a coding style more like that used by typical programmers
than the Legacy tests, and have a different naming convention.</div>
-<div class="Normal"><A NAME="I1092"></A><B>Specialized Needs Annex.</B>
+<div class="Normal"><A NAME="I1095"></A><B>Range indicator.</B> A range
+indicator provides detailed information about the expected location of
+an error; tests using range indicators can be graded more accurately
+by the grading tool.</div>
+<div class="Normal"><A NAME="I1096"></A><B>Specialized Needs Annex.</B>
(Abbreviated <B>SNA</B>) One of annexes C through H of <A HREF="UG-01.HTM#Ada95">[Ada95]</A>.
Conformity testing against one or more Specialized Needs Annexes is optional.
There are tests that apply to each of the Specialized Needs Annexes.
Results of processing these tests (if processed during a conformity assessment)
-are reported on the certificate and in the Certified Processors List.<A NAME="I1093"></A></div>
-<div class="Normal"><A NAME="I1094"></A><B>Test Objective.</B> The intended
+are reported on the certificate and in the Certified Processors List.<A NAME="I1097"></A></div>
+<div class="Normal"><A NAME="I1098"></A><B>Test Objective.</B> The intended
purpose of an ACATS test. A test objective ought to be relatable to rules
given in the Standards that define Ada.</div>
-<div class="Normal"><A NAME="I1095"></A><B>Test Objectives Document.</B>
+<div class="Normal"><A NAME="I1099"></A><B>Test Objectives Document.</B>
A document containing the test objectives used for Modern ACATS tests.
Information on Legacy tests is not included.</div>
-<div class="Normal"><A NAME="I1096"></A><B>Validated Compilers List.</B>
+<div class="Normal"><A NAME="I1100"></A><B>Test Summary.</B> A list of
+information about one or more ACATS tests, describing the test requirements
+to the grading tool.</div>
+<div class="Normal"><A NAME="I1101"></A><B>Validated Compilers List.</B>
(Abbreviated <B>VCL</B>) Former designation of the Certified Processors
-List.<A NAME="I1097"></A></div>
-<div class="Normal"><A NAME="I1098"></A><B>Validated Implementation.</B>
+List.<A NAME="I1102"></A></div>
+<div class="Normal"><A NAME="I1103"></A><B>Validated Implementation.</B>
Informally used to mean Conforming Implementation.</div>
-<div class="Normal"><A NAME="I1099"></A><B>Validation.</B> Informally
+<div class="Normal"><A NAME="I1104"></A><B>Validation.</B> Informally
used to mean conformity assessment.</div>
-<div class="Normal"><A NAME="I1100"></A><B>Withdrawn Test.</B> A test
+<div class="Normal"><A NAME="I1105"></A><B>Withdrawn Test.</B> A test
found to be incorrect and not used in conformity testing. A test may
be incorrect because it has an invalid test objective, fails to meet
its test objective, or contains erroneous or illegal use of the Ada programming
language. Withdrawn tests are not applicable to any implementation. Withdrawn
tests are often modified and restored to subsequent ACATS releases.</div>
-<div class="Normal"><A NAME="I1101"></A><B>Witness Testing.</B> Conformity
+<div class="Normal"><A NAME="I1106"></A><B>Witness Testing.</B> Conformity
assessment testing performed in the presence of ACAL personnel. Witness
testing adds the assurance that the test procedures were followed and
that the results were verified.</div>
Questions? Ask the ACAA Technical Agent