Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4857

When no partition pruning occurs with metadata caching there's a performance regression

    XMLWordPrintableJSON

    Details

      Description

      After DRILL-4530, we see the (expected) performance improvements in planning time with metadata cache for cases where partition pruning got applied. However, in cases where it did not get applied and for sufficiently large number of files (tested with up to 400K files), there's performance regression. Part of this was addressed by DRILL-4846. This JIRA is to track some remaining fixes to address the regression.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                amansinha100 Aman Sinha
                Reporter:
                amansinha100 Aman Sinha
                Reviewer:
                Dechang Gu
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: