[DRILL-5674] Drill should support .zip compression

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.17.0
• Component/s: Storage - Text & CSV
• Labels: doc-impacting
• Assignee: Arina Ielchiieva
• Reporter: Paul Rogers
• Reviewer: Paul Rogers
• Created: 17/Jul/17 21:33
• Updated: 23/Oct/19 10:41
• Resolved: 23/Oct/19 10:41

Description

Zip is a very common compression format. Create a compressed CSV file with column headers: data.csv.zip.

Define a storage plugin config for the file, call it "dfs.myws", set delimiter = ",", extract header = true, skip header = false.

Run a simple query:

SELECT * FROM dfs.myws.`data.csv.zip`

The result is garbage as the CSV reader is trying to parse Zipped data as if it were text.

DRILL-5506 asks how to do this; the responder said to add a library to the path. Better would be to simply support zip out-of-the-box as a default format.

Issue Links

• is related to: DRILL-5506 Apache Drill Querying data from compressed .zip file
• links to: GitHub Pull Request #1879