Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-535

HbaseGroupScan should return more accurate size information.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.6.0
    • None
    • None

    Description

      Currently, HbaseGroupScan.getSize() returns a default number, which will impact planner's ability to make a right decision, when it decides a good join order.

      Ideally, getSize() should get row count for HTable. As a first step, it would be good to get total bytes, which will convert to a rough estimation of row count. The total bytes could be obtained by checking the HDFS file for the HTable.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. DRILL-1346 Use HBase table size information to improve scan parallelization

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              adityakishore Aditya Kishore
              jni Jinfeng Ni
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: