[SPARK-1568] Spark 0.9.0 hangs reading s3

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Assignee: Unassigned
• Reporter: sam
• Created: 22/Apr/14 18:59
• Updated: 14/Nov/14 15:23
• Resolved: 14/Nov/14 15:23

Description

I've tried several jobs now and many of the tasks complete, then it get stuck and just hangs. The exact same jobs function perfectly fine if I distcp to hdfs first and read from hdfs.

Many thanks