[SPARK-7062] Parquet compression does not work for Spark SQL loading

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 1.4.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Yi Yao
• Created: 23/Apr/15 01:10
• Updated: 23/Apr/15 04:16
• Resolved: 23/Apr/15 04:16

Description

I tried to set the following parameters while loading data.

set parquet.compression=snappy;
set spark.sql.parquet.compression.codec=snappy;

But, both above parameters do not work.

[SQL]
CREATE TABLE IF NOT EXISTS t2
STORED AS PARQUET
AS
SELECT * FROM t1;

t1 is an external table stored as TEXTFILE.

Issue Links

• duplicates: SPARK-7051 Support Compression write for Parquet