During 2.4.0 RC4 testing, we noticed an issue with kubernetes-integration-tests and Scala 2.12 (
SPARK-25835), and that the build was actually publishing kubernetes-integration-tests. The tests are also complicated in some ways and require some setup to run. This is being simplified in SPARK-25809 for later.
These tests, it seems, can be instead run ad hoc manually for now, given the above. A quick fix is to not enable this module even with the kubernetes profile is active.