Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-25148

Scan metrics are not reported to Hadoop MapReduce counters

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.2.0
    • None
    • Client, mapreduce, scan
    • None

    Description

      I setup a MapReduce job that scans HBase table with scan metrics enabled via Java API:

      Scan scan = ...;
      scan.setScanMetricsEnabled(true);
      // Or via attribute
      scan.setAttribute(                                               
              Scan.SCAN_ATTRIBUTES_METRICS_ENABLE,                             
              Bytes.toBytes(true));
      TableMapReduceUtil.initTableMapperJob(...);                                                                 
      job.waitForCompletion(true)
      

      I expect HBase scan related counters to appear with current values in Hadoop web UI after job starts or in CLI after job ends alongside other counters such as CPU_MILLISECONDS. But no metrics were displayed. I can clearly see that scan is performed and mappers got non-zero inputs.

      The JAR version is  1.2.0-cdh5.16.1.

      Attachments

        Activity

          People

            Unassigned Unassigned
            Leonid Vasilev Leonid Vasilev
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: