Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11299

Support multiple Datanode File IO hooks

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha2
    • Component/s: hdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HDFS-10958 introduces instrumentation hooks around DataNode disk IO and HDFS-10959 adds support for profiling hooks to expose latency statistics.
      Instead of choosing only one hook using Config parameters, we want to add two separate hooks - one for profiling and one for fault injection. The fault injection hook will be useful for testing purposes.
      This jira only introduces support for fault injection hook. The implementation for that will come later on.
      Also, now Default and Counting FileIOEvents would not be needed as we can control enabling the profiling and fault injection hooks using config parameters.

        Attachments

        1. HDFS-11299.000.patch
          57 kB
          Hanisha Koneru
        2. HDFS-11299.001.patch
          56 kB
          Hanisha Koneru
        3. HDFS-11299.002.patch
          57 kB
          Hanisha Koneru

          Activity

            People

            • Assignee:
              hanishakoneru Hanisha Koneru
              Reporter:
              hanishakoneru Hanisha Koneru
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: