Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-11698

Ozone local reads do not update local-bytes-read

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Backend
    • ghx-label-8

    Description

      https://github.com/apache/impala/blob/7a28295905e97e41503670bbdd92e64ea47f0078/be/src/runtime/io/hdfs-file-reader.cc#L394-L417 updates several metrics that were previously specific to HDFS. The local-bytes-read and erasure-coded-bytes-read metrics make sense for Ozone as Ozone datanodes can be co-located with Impala executors and support erasure coding. It's currently not updated for co-located Ozone reads or erasure-coded reads.

      I don't see any way to get these metrics from Ozone currently.

      Attachments

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. HDDS-7613 Provide method to get read metrics via hdfsFileGetReadStatistics

          • Major - Major loss of function.
          • Open
          is related to

          Sub-task - The sub-task of the issue IMPALA-11697 Enable SkipIf tests specific to HDFS for Ozone

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-11883 erasure-coded-bytes-read metric doesn't work for Ozone

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-11476 Support for Ozone with Erasure Coding

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              MikaelSmith Michael Smith
              MikaelSmith Michael Smith
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: