Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5843 Use page index in Parquet files to skip pages
  3. IMPALA-7543

Enhance scan ranges to support sub-ranges

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 3.1.0
    • None
    • None
    • ghx-label-4

    Description

      For IMPALA-5843 we need to have smarter scan ranges that only read a list of inner ranges.

      It'll be useful for Parquet files that have page index, so Impala will only read the relevant pages.

      More information can be found in https://docs.google.com/document/d/1D-el8njq_I-JKd3NDcW1mRXID_n0dBDKIkjWxwULVus

       

      Attachments

        Issue Links

          Blocked

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-7556 Clean up ScanRange

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-8109 Impala cannot read the gzip files bigger than 2 GB

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              boroknagyz Zoltán Borók-Nagy
              boroknagyz Zoltán Borók-Nagy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: