The ULR validatesRunner tests currently fail for the vast majority of tests. This bug is for tracking progress on getting all the tests to pass.
Gradle command to run the tests:
./gradlew -p runners/direct-java validatesPortableRunner
If you get any errors related to docker, make sure you have a docker container built:
./gradlew -p sdks/java/container docker
Bugs encountered while working on this should be tracked either as new sub-tasks to the parent issue or as seperate bugs that are marked as blocking this.