Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-7834

Add Utility Functions for Compressed Files

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Done
    • Affects Version/s: 1.17.0
    • Fix Version/s: 1.19.0
    • Component/s: Storage - Text & CSV
    • Labels:
      None

      Description

      Some format plugins that use third party parsers throw errors when they receive compressed input streams from Drill. This PR proposes to introduce three utility functions to the DrillFileSystem:

      1. isCompressed(<path>): Returns true/false whether the input file is compressed
      2. getCodec(<path>): This method returns the codec of the file if any
      3. openDecompressedInputStream(<path>): Returns an InputStream that should be readable by parsers that read raw bytes. This method converts the original InputStream to a byte[] first, then returns that via a ByteArrayInputStream.

        Attachments

          Activity

            People

            • Assignee:
              cgivre Charles Givre
              Reporter:
              cgivre Charles Givre
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: