Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11339

Support File IO sampling for Datanode IO profiling hooks

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HDFS-10958 introduces instrumentation hooks around DataNode disk IO and HDFS-10959 adds support for profiling hooks to expose latency statistics.
      Instead of profiling all the file IO events, we can sample a fraction of the events and profile them. The fraction to be sampled can be configurable.

        Attachments

        1. HDFS-11339.003.patch
          6 kB
          Hanisha Koneru
        2. HDFS-11339.002.patch
          4 kB
          Hanisha Koneru
        3. HDFS-11339.001.patch
          5 kB
          Hanisha Koneru
        4. HDFS-11339.000.patch
          5 kB
          Hanisha Koneru

          Activity

            People

            • Assignee:
              hanishakoneru Hanisha Koneru
              Reporter:
              hanishakoneru Hanisha Koneru
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: