Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12615 Router-based HDFS federation phase 2
  3. HDFS-13347

RBF: Cache datanode reports

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.1.0, 2.10.0, 2.9.1, 3.0.3
    • None
    • None
    • Reviewed

    Description

      Getting the datanode reports is an expensive operation and can be executed very frequently by the UI and watchdogs.
      To reduce this load, this information is cached in the Router.
      This cached information expires after some time (configurable).

      Attachments

        1. HDFS-13347-branch-2.000.patch
          15 kB
          Íñigo Goiri
        2. HDFS-13347.006.patch
          15 kB
          Íñigo Goiri
        3. HDFS-13347.005.patch
          15 kB
          Íñigo Goiri
        4. HDFS-13347.004.patch
          15 kB
          Íñigo Goiri
        5. HDFS-13347.003.patch
          13 kB
          Íñigo Goiri
        6. HDFS-13347.002.patch
          13 kB
          Íñigo Goiri
        7. HDFS-13347.001.patch
          13 kB
          Íñigo Goiri
        8. HDFS-13347.000.patch
          5 kB
          Íñigo Goiri

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HDFS-13364 RBF: Support NamenodeProtocol in the Router

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-15432 RBF: Move cache datanode reports from NamenodeBeanMetrics to RouterRpcServer

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              elgoiri Íñigo Goiri
              elgoiri Íñigo Goiri
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: