Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15125 Complete integration of new StorageStatistics
  3. HADOOP-13032

Refactor FileSystem$Statistics to use StorageStatistics

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • fs
    • None
    • Incompatible change

    Description

      HADOOP-13065 added a new interface for retrieving FS and FC Statistics. This jira is to track the effort of moving the Statistics class out of FileSystem, and make it use that new interface.

      We should keep the thread local implementation. Benefits are:

      1. they could be used in both FileContext and FileSystem
      2. unified stats data structure
      3. shorter source code

      Please note this will be an backwards-incompatible change.

      Attachments

        1. HADOOP-13032.000.patch
          178 kB
          Mingliang Liu
        2. HADOOP-13032.001.patch
          186 kB
          Mingliang Liu
        3. HADOOP-13032.002.patch
          198 kB
          Mingliang Liu
        4. HADOOP-13032.003.patch
          198 kB
          Mingliang Liu
        5. HADOOP-13032.004.patch
          194 kB
          Mingliang Liu
        6. HADOOP-13032.005.patch
          209 kB
          Mingliang Liu

        Issue Links

          blocks

          Sub-task - The sub-task of the issue HADOOP-13031 Rack-aware read bytes stats should be managed by HFDS specific StorageStatistics

          • Major - Major loss of function.
          • Open
          is blocked by

          Sub-task - The sub-task of the issue HADOOP-13435 Add thread local mechanism for aggregating file system storage stats

          • Major - Major loss of function.
          • Patch Available
          is related to

          Sub-task - The sub-task of the issue HADOOP-13454 S3Guard: Provide custom FileSystem Statistics.

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13992 cross-cluster rack awareness for distcp

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              liuml07 Mingliang Liu
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated: