Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7304

Impala shouldn't write column indexes for float columns until PARQUET-1222 is resolved

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.13.0, Impala 3.1.0
    • Impala 2.13.0, Impala 3.1.0
    • None
    • None
    • ghx-label-2

    Description

      Impala master branch can already write the Parquet page index.
       
      However, we still don't have well-defined ordering for floating-point numbers in Parquet: PARQUET-1222
       
      Currently impala writes the page index with fmax()/fmin() semantics, but it might contradicts the future specification that will be defined once PARQUET-1222 is resolved.
       
      We should not write column indexes for floating-point columns until PARQUET-1222 is resolved.

      Attachments

        Issue Links

          Activity

            People

              boroknagyz Zoltán Borók-Nagy
              boroknagyz Zoltán Borók-Nagy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: