[SPARK-11652] Remote code execution with InvokerTransformer

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.4.2, 1.5.3, 1.6.0
• Component/s: Spark Core
• Assignee: Sean R. Owen
• Reporter: Daniel Darabos
• Created: 11/Nov/15 10:11
• Updated: 14/Mar/17 08:07
• Resolved: 18/Nov/15 09:07

Description

There is a remote code execution vulnerability in the Apache Commons collections library (https://issues.apache.org/jira/browse/COLLECTIONS-580) that can be exploited simply by causing malicious data to be deserialized using Java serialization.

As Spark is used in security-conscious environments I think it's worth taking a closer look at how the vulnerability affects Spark. What are the points where Spark deserializes external data? Which are affected by using Kryo instead of Java serialization? What mitigation strategies are available?

If the issue is serious enough but mitigation is possible, it may be useful to post about it on the mailing list or blog.

Thanks!

Issue Links

• is duplicated by: SPARK-11682 Commons-collections object deserialization may expose remote command execution vulnerability
• is duplicated by: SPARK-19943 commons-collections has vulnerability: CVE-2015-6420
• links to: [Github] Pull Request #9731 (srowen)
• links to: [Github] Pull Request #10198 (srowen)