Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-12333

Ozone: Extend Datanode web interface with SCM information

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HDFS-7240
    • Fix Version/s: HDFS-7240
    • Component/s: HDFS-7240
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Current Datanode web interface shows information about the Block Pools:

      • Namenode Address
      • BlockPoolID
      • ActorState
      • Last Heartbeat
      • Last Block Report

      I propose in this jira to add the same information about the SCM (if the datanode is a member of ozone cluster). It would help to check the current state of the datanode (is ozone enabled? Is there an active connection to the SCM?)

      1. Suggested information to display:

      • SCM hostname/address
      • EndpointState (GETVERSION, REGISTER, HEARTBEAT, SHUTDOWN)
      • version (from the VersoinResponse)
      • missedCount

      They could be displayed with publishing JMX information from SCMConnectionManager or EndpointStateMachines.

      2. StorageLocationReport[] from the ContainerLocationManager also should be exposed over JMX and displayed on the web interface:

      • id
      • failed (bool)
      • capacity
      • scmUsed
      • remaining

      3. Possible report of Last Heartbeat/Container report should be investigated.

        Attachments

        1. HDFS-12333-HDFS-7240.001.patch
          19 kB
          Marton Elek
        2. HDFS-12333-HDFS-7240.002.patch
          19 kB
          Marton Elek
        3. HDFS-12333-HDFS-7240.003.patch
          18 kB
          Marton Elek
        4. ozonedatanode.png
          72 kB
          Marton Elek

          Activity

            People

            • Assignee:
              elek Marton Elek
              Reporter:
              elek Marton Elek
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: