Koji tracked down this one.
So, cachearchive like class.zip or class.tar.gz were never set as part of the
classpath even though they were properly set by DistributedCache.addArchiveToClassPath.
It looks like we are parsing the classpath out of the configs, but then throwing that away. It looks simple enough to add them in the correct place.