Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5840

Don't write page level statistics in Parquet files in anticipation of page indexes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.9.0
    • Impala 2.10.0
    • Backend

    Description

      The Parquet project is very likely to deprecate page level statistics in favor of page indexes (PARQUET-922). We should stop writing the page level statistics now since we don't plan to add read support for them.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-5842 Write page index in Parquet files

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-5841 Write page index in Parquet files

          • Major - Major loss of function.
          • Resolved
          requires

          Improvement - An improvement or enhancement to an existing feature or task. PARQUET-922 Add index pages to the format to support efficient page skipping

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              lv Lars Volker
              lv Lars Volker
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: