[SPARK-7602] add lz4 decompressor for streamContext.fileStream

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 1.3.1
• Component/s: Input/Output

Environment

spark 1.3.1 , hadoop 2.6.0, yarn

• Flags: Patch
• Assignee: Unassigned
• Reporter: hotdog
• Created: 13/May/15 15:23
• Updated: 13/May/15 15:27
• Resolved: 13/May/15 15:27

Description

I 'm using spark streaming, and the files in my hdfs are compressed using lz4 format. But I could not find how to decompress lz4 format using fileStream