CASA Application Smoke Tests

Status: INCOMPLETE DRAFT

Definition

Application Smoke tests are automated tests used to verify an application built and linked correctly.

Purpose

Requirements

Smoke tests shall verify an application (command line program or GUI) will,

• start,
• will not raise any
• exit with a exit code of 0.

Reccomendations

• CASA Smoke tests shall meet all requirements for CASA Automated Tests.
• CASA Developers shall control which tests are run as smoke tests.
  • TODO: Add CMake support for identifying smoke tests and adding them to the "make test" target.

Notes

• casacore and asap developers already control which tests run from the "make test" target in their build systems.

• ISSUE (with requirements):
  • Not all CASA applications will exit if no commands are given.
  • CASA application command line handling is inconsistent. Not all CASA applications handle command line options.

• Notes:
  • A more useful smoke test would verify "usage" information is displayed when either a "-h" or a "--help" option is provided.
  • An even more useful smoke test would verify each application does useful small task before completing. This will have to be customized.

-- ScottRankin - 2011-01-03