[MYNEWT-41] Improve regression test coverage

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Won't Fix
• Component/s: Baselibc, Bootloader, BSP, Flash, HAL, Image Mgmt, JSON, Misc, NFFS, Nimble, OS
• Security Level: Public (Viewable by anyone)
• Assignee: Peter Snyder
• Reporter: Sterling Hughes
• Created: 07/Feb/16 19:01
• Updated: 05/Jun/17 17:20
• Resolved: 05/Jun/17 17:20

Description

We need a push behind regression test coverage for nearly every component. NFFS and Nimble host are pretty good, but the rest have sadly large gaps in regression testing.

I think a couple of rules prior to release would make sense:

1- Every package must have at least 1 regression test.
2- The libs/os and hw/hal packages should have every API covered by regression tests (anything in tadpole)
3- We should have a picture of regression test coverage prior to release via some sort of automated tool.