ACAA Header
 

Ada Conformity Assessment Test Suite (ACATS)

The Ada Conformity Assessment Test Suite (ACATS) is the test suite used for Ada processor conformity testing. This site includes the official versions of the test files.
Informal comments and questions on the ACATS should be sent to the ACAA Technical Agent, agent@ada-auth.org. Formal test disputes should submitted to the agent as described in the ACAA procedures.
Note: The ACAA has created and maintains the Ada Conformity Assessment Test Suite for the purpose of conformity assessments conducted in accordance with the International Standard ISO/IEC 18009 - Ada: Conformity assessment of a language processor. This test suite should not be used to make claims of conformance unless used in accordance with ISO/IEC 18009 and any applicable ACAA procedures.

Overview

The ACATS is available in versions for each major version of Ada: ACATS 4.1 for Ada 2012, ACATS 3.1 for Ada 2005, ACATS 2.6 for Ada 95, and ACATS 1.11 for Ada 83. Click here for a convenient table of ACATS and ACVC versions.
For each maintained version, there is an associated ACATS Modification List, which lists all of the modifications made to the baseline test suite. This includes test corrections, removals, and additions. Each ACATS Modification List has an associated Modified Test File, which contains all of the changed and added tests. These files simplify the task of getting a completely up-to-date test suite, as only three files are needed (the baseline test suite, the most recent Modified Test File, and the most recent ACATS Modification List [the latter is required only to determine the tests to delete]).
In addition, individual test files can be retrieved from the ACATS Master Version Control System. The VCS includes the change history for individual files, so older versions of a test file can be retrieved.
See Submitted Tests for tests and tools submitted by Ada users and implementers for possible inclusion in the ACATS. These tests and tools are not part of the ACATS, but are provided as a service to the community. Some of these tests and tools may be added to the ACATS in the future.

ACAA Mailing List

To keep up to date with the ACATS, join the ACAA mailing list. The list contains announcements from the ACAA (such as the issuance of new ACATS Modication Lists, including new and modified tests) and discussion about Ada Conformity Testing. The list is open to anyone with an interest in testing of Ada implementations. To subscribe, send a message with the body text "Join ACAA" to listserv@ada-auth.org.

ACATS Test Construction Mailing List

If you are interested in constructing potential ACATS Tests, join the ACATS Test mailing list. The list contains discussion about the design and construction of tests to be submitted as possible future ACATS Tests. The list is the place to get questions answered about designing tests that check the Standard as opposed to a single implementation. The list is open to anyone with an interest in test creation for testing of Ada implementations. To subscribe, send a message with the body text "Join ACATS-Test" to listserv@ada-auth.org.


ACATS Baseline Versions

ACATS 4.1

ACATS 4.1 is the current baseline version of the test suite for Ada. The files here contain the entire baseline test suite; use the ACATS Master Version Control System to get individual files. Add the appropriate modified tests to this baseline (see below).
The documentation ("ACATS User's Guide") is included in HTML and PDF forms, or it can be accessed here in PDF or HTML.
ZIP file (the file size is an estimate):
ACATS41.ZIP (10228K)
Compressed tar file (the file size is an estimate):

ACATS 3.1

ACATS 3.1 is the current baseline version of the test suite for the 2007 version of Ada (which is conventionally known as Ada 2005). It is trapexpected to be the last baseline version for the 2007 version of Ada. The files here contain the entire baseline test suite; use the ACATS Master Version Control System to get individual files. Add the appropriate modified tests to this baseline (see below).
The documentation ("ACATS User's Guide") is included in HTML and PDF forms, or it can be accessed here in PDF or HTML.
ZIP file (the file size is an estimate):
ACATS31.ZIP (8710K)
Compressed tar file (the file size is an estimate):

ACATS 2.6

ACATS 2.6 is the current baseline version of the test suite for Ada 95. It became effective April 2, 2007. (Note that the ACATS was known as the ACVC prior to October 1998.) It is the last baseline version for the 1995 version of Ada. The files here contain the entire baseline test suite; use theblock ACATS Master Version Control System to get individual files. Add the appropriate modified tests to this baseline (see below).
The documentation is included in text and PDF forms.
ZIP file (the file size is an estimate):
ACATS26.ZIP (7377K)
Compressed tar file (the file size is an estimate):

ACVC 1.11

ACVC 1.11 was the last baseline version of the test suite for Ada 83. Unlike the other ACATS versions, it is no longer maintained. Thus, we do not offer a modification list for it, individual files aren't available, and it not conviniently available as a single download. It can be found in the AdaIC archives at http://archive.adaic.com/compilers/acvc/83acvc/.


ACATS Modification List

The ACATS Modification List lists all of the modifications made to the current baseline test suite. This includes withdrawn (deleted) tests, modified (corrected) tests, and new tests. The current version of the list is available here; for older versions of the ACATS Modification List, use the ACATS Master Version Control System. Click here for a direct link to the ACATS modification list.

For ACATS 4.1:

For ACATS 3.1:

Note: Since October 1st, 2021, ACATS 3.1 has been on limited maintenance, meaning new tests will not be issued for it. The following new tests have Ada 2005 objectives and may be appropriate for testing an implementation of Ada 2005:

For ACATS 2.6:

Note: Since October 1st, 2021, ACATS 2.6 has been on limited maintenance, meaning new tests will not be issued for it. The following new tests have Ada 95 objectives and may be appropriate for testing an implementation of Ada 95:


Modified Test Files

These files contain the all of the current, official modified (and new) test files. Use these files with the appropriate ACATS Modification List in order to have all of the files required for conformity assessment. The files here contain all of the modified tests; use the ACATS Master Version Control System to get individual files. Old versions of the modified tests are available at the bottom of this page. Normally, you will need only the most recent version.

For ACATS 4.1:

For ACATS 3.1:

For ACATS 2.6:



ACATS Master Version Control System

The master version control system for the ACATS is available on this web site. You can retrieve any version of an individual test file, including those used for a specific conformity assessment. In order to retrieve files for a specific conformity assessment, you'll need to know the VCS tag for that assessment (it can be found in the test report).
Once in the VCS, you can browse the file hierarchy by picking directories (which have slashes after them, e.g. src/). If you pick a file, you will see the revision history for that file. (Note that versions of files prior to version 2.1 of the test suite are not available.) Selecting a revision number or name will download that revision of the file. There is a link at each revision to display differences between that revision and the previous one, and a form at the bottom of the page that allows you to display differences between arbitrary revisions. Items marked as being in the Attic are deleted. Deleted items are still available in case they are needed when looking at a previous version of a test.
Most files in the VCS are stored based on their prefixes. For instance, test CD92001.A can be found in the directory (folder) CD. However, some files are found in other directories. The New directory contains tests added to the test suite since its last major release. The Docs directory includes documentation, including the Modified Tests List. The Support directory contains support files used by multiple tests, including the Report package, and the foundation files. The Tools directory contains the (Ada) source code for some tools used to manage the ACATS.




Previous Versions of Files

ACATS 2.1

ACATS 2.1 is an old baseline version of the test suite. This version was replaced by ACATS 2.2 on April 5, 1999. (Note that the ACATS was known as the ACVC prior to October 1998; the test suite documentation uses the old name.) The files here contain the entire test suite; use the ACATS Master Version Control System to get individual files.

ACATS 2.2

ACATS 2.2 is an old baseline version of the test suite. This version was replaced by ACATS 2.3 on April 1, 2000. (Note that the ACATS was known as the ACVC prior to October 1998; the test suite documentation uses the old name.) The files here contain the entire test suite; use the ACATS Master Version Control System to get individual files.

ACATS 2.3

ACATS 2.3 is an old baseline version of the test suite. This version was replaced by ACATS 2.4 on April 1, 2001. The files here contain the entire test suite; use the ACATS Master Version Control System to get individual files.

ACATS 2.4

ACATS 2.4 is an old baseline version of the test suite. This version was replaced by ACATS 2.5 on April 1, 2002. The files here contain the entire test suite; use the ACATS Master Version Control System to get individual files.

ACATS 2.5

ACATS 2.5 is an old baseline version of the test suite. This version was replaced by ACATS 2.6 on April 2, 2007. The files here contain the entire test suite; use the ACATS Master Version Control System to get individual files.

ACATS 3.0

ACATS 3.0 is an old baseline version of the test suite for Ada. This version was replaced by ACATS 3.1 on April 1, 2014. It was the first baseline version for the 2007 version of Ada (which is conventionally known as Ada 2005). trap The files here contain the entire baseline test suite; use the ACATS Master Version Control System to get individual files.
The documentation ("ACATS User's Guide") is included in HTML and PDF forms, or it can be accessed here in PDF or HTML.
ZIP file (the file size is an estimate):
ACATS30.ZIP (8049K)
Compressed tar file (the file size is an estimate):

ACATS 4.0

ACATS 4.0 is an old baseline version of the test suite for Ada. This version was replaced by ACATS 4.1 on July 1, 2016. It was the first baseline version for the 2012 Ada Revision. The files here contain the entire baseline test suite; use the ACATS Master Version Control System to get individual files. Add the appropriate modified tests to this baseline (see below).
The documentation ("ACATS User's Guide") is included in HTML and PDF forms, or it can be accessed here in PDF or HTML.
ZIP file (the file size is an estimate):
ACATS40.ZIP (9390K)
Compressed tar file (the file size is an estimate):

Superceded Modified Test Files

These files contain the all of the official modified (and new) test files for previous versions of the ACATS Modification List. The files here contain all of the modified tests; use the ACATS Master Version Control System to get individual files. Old versions of the modified tests are available for those who want to test a particular conformity assessment. Normally, you will need only the most recent version, available above. Note that for older versions, the only versions available here are those used for one or more confirmity assessments.
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
Modified Tests 3.1N (Zip file) [Note: Same as 3_1M.]
Modified Tests 3.1N (Tar file) [Note: Same as 3_1M.]
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
---
Modified Tests 2.3F (Zip file) (also used for 2.3G)
---
---
---
---
---
---
---
---
---
---
---
---

ACATS 3.0 Development Snapshots

ACATS 3.0 was developed in stages during 2007. ACATS 3.0 development snapshots were provided to give the Ada community an early look at the tests intended for inclusion in ACATS 3.0. They are formatted like an ACATS Modification List as a list of changes to be made to the existing ACATS 2.6, and an associated set of test files. This includes withdrawn (deleted) tests, modified (corrected) tests, and new tests. For almost all purposes, the released version of ACATS 3.0 should be used instead of these snapshots.

ACATS 4.0 Development Snapshots

ACATS 4.0 was developed in stages during 2014. ACATS 4.0 development snapshots were provided to give the Ada community an early look at the tests intended for inclusion in ACATS 4.0. They are formatted like an ACATS Modification List as a list of changes to be made to the existing ACATS 3.1, and an associated set of test files. This includes withdrawn (deleted) tests, modified (corrected) tests, and new tests. For almost all purposes, the released version of ACATS 4.0 should be used instead of these snapshots.
Documentation (PDF file):
ZIP file:
Compressed tar file: