[DAFFODIL-2811] sbt IntegrationTest being deprecated, need alternative for slow CLI tests

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.5.0
• Component/s: CLI, Infrastructure
• Assignee: Unassigned
• Reporter: Steve Lawrence
• Created: 03/May/23 15:52
• Updated: 10/May/23 18:13
• Resolved: 08/May/23 19:16

Description

SBT 1.9.0 is planning on deprecating the IntegrationTest configuration:

https://eed3si9n.com/sbt-1.9.0-beta

We currently use this config for slow running CLI tests that fork. With the upcoming release of 1.9.0, we may want to consider an alternative. Some requirements for the alternative:

• Should allow running the tests in an IDE, which is currently difficult/impossible since not all IDE's support the IntegrationTest config
• The CLI integration tests depend on the "daffodil-cli/stage" task since they actually execute the binary. Whatever alternative we choose should not run that task unless integration tests are actually run since staging the CLI can take awhile. We don't want to slow down the normal test cycle
• We need the ability to disable parallelization when running these tests, otherwise we can quickly run out of memory on systems with limited resources (e.g. GitHub actions)
• The tests should not run by default when running "sbt test". They are expensive and time consuming and usually don't need to be run as frequently as normal tests.