Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11299

Support multiple Datanode File IO hooks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha2
    • hdfs
    • None
    • Reviewed

    Description

      HDFS-10958 introduces instrumentation hooks around DataNode disk IO and HDFS-10959 adds support for profiling hooks to expose latency statistics.
      Instead of choosing only one hook using Config parameters, we want to add two separate hooks - one for profiling and one for fault injection. The fault injection hook will be useful for testing purposes.
      This jira only introduces support for fault injection hook. The implementation for that will come later on.
      Also, now Default and Counting FileIOEvents would not be needed as we can control enabling the profiling and fault injection hooks using config parameters.

      Attachments

        1. HDFS-11299.002.patch
          57 kB
          Hanisha Koneru
        2. HDFS-11299.001.patch
          56 kB
          Hanisha Koneru
        3. HDFS-11299.000.patch
          57 kB
          Hanisha Koneru

        Activity

          People

            hanishakoneru Hanisha Koneru
            hanishakoneru Hanisha Koneru
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: