[DRILL-7834] Add Utility Functions for Compressed Files

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Done
• Affects Version/s: 1.17.0
• Fix Version/s: 1.19.0
• Component/s: Storage - Text & CSV
• Assignee: Charles Givre
• Reporter: Charles Givre
• Created: 04/Jan/21 00:17
• Updated: 04/Jan/21 16:49
• Resolved: 04/Jan/21 16:49

Description

Some format plugins that use third party parsers throw errors when they receive compressed input streams from Drill. This PR proposes to introduce three utility functions to the DrillFileSystem:

1. isCompressed(<path>): Returns true/false whether the input file is compressed
2. getCodec(<path>): This method returns the codec of the file if any
3. openDecompressedInputStream(<path>): Returns an InputStream that should be readable by parsers that read raw bytes. This method converts the original InputStream to a byte[] first, then returns that via a ByteArrayInputStream.