Recently, I came across a few simple ML bugs that should have been caught by basic checks, but there was a lack of coverage because the existing checks are just tacked on to other tests and easy to forget to add to new test suites.
I think it's worth spending some time to making these checks more standardized and easy to bring into new test suites so they are not overlooked - possibly by using a trait.
The basic checks I'm referring to are:
- parameter checks
- uid checks
- model/estimator copies
- model/estimator persistence