[SPARK-1316] Remove use of Commons IO

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 1.1.0
• Component/s: Spark Core
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 25/Mar/14 08:11
• Updated: 15/Jan/15 09:08
• Resolved: 23/Jun/14 01:03

Description

(This follows from a side point on SPARK-1133, in discussion of the PR: https://github.com/apache/spark/pull/164 )

Commons IO is barely used in the project, and can easily be replaced with equivalent calls to Guava or the existing Spark Utils.scala class.

Removing a dependency feels good, and this one in particular can get a little problematic since Hadoop uses it too.