Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4152

Add additional logging and metrics to the Parquet reader

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: Storage - Parquet
    • Labels:
      None

      Description

      In some cases, we see the Parquet reader as the bottleneck in reading from the file system. RWSpeedTest is able to read 10x faster than the Parquet reader so reading from disk is not the issue. This issue is to add more instrumentation to the Parquet reader so speed bottlenecks can be better diagnosed.

        Attachments

          Activity

            People

            • Assignee:
              parthc Parth Chandra
              Reporter:
              parthc Parth Chandra
              Reviewer:
              Dechang Gu
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: