Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10405

Consider setting parquet_page_row_count_limit to 20000 by default

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Backend

    Description

      PARQUET-1414 did some experiments for parquet-mr that concluded that this setting would enhance page filtering without giving up much compression. It's the default over there.

      We should probably just do the same in Impala because we already have that evidence that it's better and we can avoid it being a confounding factor.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              tarmstrong Tim Armstrong
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: