[SPARK-14482] Change default compression codec for Parquet from gzip to snappy

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: SQL
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 08/Apr/16 07:15
• Updated: 13/Sep/16 23:48
• Resolved: 09/Apr/16 06:51

Description

Based on our tests, gzip decompression is very slow (< 100MB/s), making queries decompression bound. Snappy can decompress at ~ 500MB/s on a single core.

Issue Links

• links to: [Github] Pull Request #12256 (rxin)