SOLR-5109 is describing the behavior and it looks like Guava 15 is already released. Would be great, if its possible to fix it.
Sidenote: Yes, I understood. Solr should run a dedicated server and in our environment, Solr runs in a dedicated server. But, to streamline our operations, we decided to operate one application server and these is Glassfish in our case :/