Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-7028 Reduce the planning time of queries on large Parquet tables with large metadata cache files
  3. DRILL-7244

Run-time rowgroup pruning match() fails on casting a Long to an Integer

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.17.0
    • 1.17.0
    • Storage - Parquet
    • None

    Description

      See DRILL-7240 , where a temporary workaround was created, skipping pruning (and logging) instead of this failure: 

      After a Parquet table is refreshed with selected "interesting" columns, a query whose WHERE clause contains a condition on a "non interesting" INT64 column fails during run-time pruning (calling match()) with:

      org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: ClassCastException: java.lang.Long cannot be cast to java.lang.Integer

      A long term solution is to pass the whole (or the relevant part of the) schema to the runtime, instead of just passing the "interesting" columns.

       

      Attachments

        Activity

          People

            volodymyr Vova Vysotskyi
            ben-zvi Boaz Ben-Zvi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: