Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-12333

Ozone: Extend Datanode web interface with SCM information

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-7240
    • HDFS-7240
    • HDFS-7240
    • None
    • Reviewed

    Description

      Current Datanode web interface shows information about the Block Pools:

      • Namenode Address
      • BlockPoolID
      • ActorState
      • Last Heartbeat
      • Last Block Report

      I propose in this jira to add the same information about the SCM (if the datanode is a member of ozone cluster). It would help to check the current state of the datanode (is ozone enabled? Is there an active connection to the SCM?)

      1. Suggested information to display:

      • SCM hostname/address
      • EndpointState (GETVERSION, REGISTER, HEARTBEAT, SHUTDOWN)
      • version (from the VersoinResponse)
      • missedCount

      They could be displayed with publishing JMX information from SCMConnectionManager or EndpointStateMachines.

      2. StorageLocationReport[] from the ContainerLocationManager also should be exposed over JMX and displayed on the web interface:

      • id
      • failed (bool)
      • capacity
      • scmUsed
      • remaining

      3. Possible report of Last Heartbeat/Container report should be investigated.

      Attachments

        1. HDFS-12333-HDFS-7240.001.patch
          19 kB
          Marton Elek
        2. ozonedatanode.png
          72 kB
          Marton Elek
        3. HDFS-12333-HDFS-7240.002.patch
          19 kB
          Marton Elek
        4. HDFS-12333-HDFS-7240.003.patch
          18 kB
          Marton Elek

        Activity

          People

            elek Marton Elek
            elek Marton Elek
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: