Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5193

Impala reads gzip compressed text as binary when skip.header.line.count > 0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.7.0
    • Impala 2.9.0
    • Backend
    • ghx-label-9

    Description

      When creating an external table with a gzip compressed text file, using the skip.header.line.count (>0) causes Impala to read the gzip file as binary.

      See my attached testcase and test data.

      Attachments

        1. TC1
          3 kB
          Vincent Tran
        2. test.txt.gz
          0.1 kB
          Vincent Tran

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-5287 Add a test for skip.header.line.count on compressed files

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          requires

          Sub-task - The sub-task of the issue IMPALA-3905 Single-threaded scan node

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              lv Lars Volker
              thundergun Vincent Tran
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: