Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3331

Add operation specific HDFS counters for Tez UI

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Hadoop has added several operation specific counters in the FileSystem statistics (HADOOP-13065). These counters are useful to track file system operations more granularly. It would be great to track these counters for Tez and expose them via UI as well.

      Attachments

        1. TEZ-3331.wip.patch
          8 kB
          Hitesh Shah
        2. TEZ-3331.wip.2.patch
          8 kB
          Hitesh Shah
        3. TEZ-3331.wip.3.patch
          8 kB
          Hitesh Shah
        4. TEZ-3331.wip.4.patch
          17 kB
          Hitesh Shah
        5. TEZ-3331.wip.5.patch
          17 kB
          Hitesh Shah
        6. TEZ-3331.6.patch
          17 kB
          Prasanth Jayachandran
        7. TEZ-3331.7.patch
          17 kB
          Prasanth Jayachandran
        8. TEZ-3331.8.patch
          18 kB
          Prasanth Jayachandran

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-13065 Add a new interface for retrieving FS and FC Statistics

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-3339 Add Tez Counters for bytes-read-by-network-distance FileSystem metrics

          • Major - Major loss of function.
          • Open

          Activity

            People

              hitesh Hitesh Shah
              jnp Jitendra Nath Pandey
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: