[HDDS-22] Restructure SCM - Datanode protocol

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: Ozone Datanode, SCM
• Sprint: HDDS Acadia
• Assignee: Nandakumar
• Reporter: Nandakumar
• Created: 04/May/18 14:01
• Updated: 19/Sep/18 17:19
• Resolved: 19/Sep/18 17:19

Description

This jira aims at properly defining the SCM - Datanode protocol.

EBNF of Heartbeat

Heartbeat ::= DatanodeDetails | NodeReport | ContainerReports | ContainerActions | PipelineReports
  DatanodeDetails ::= UUID | IpAddress | Hostname | Port
    Port ::= Type | Value
  NodeReport ::= NodeIOStats | StorageReports
    NodeIOStats ::= ContainerOps | KeyOps | ChunkOps
      ContainerOps ::= CreateCount | DeleteCount| GetInfoCount
      KeyOps ::= putKeyCount | getKeyCount | DeleteKeyCount | ListKeyCount
      ChunkOps ::= WriteChunkCount | ReadChunkCount | DeleteChunkCount
    StorageReports ::= zero or more StorageReport	
      StorageReport ::= StorageID | Health | Used | Available | VolumeIOStats
        Health ::= Status | ErrorCode | Message
        VolumeIOStats ::= ReadBytes | ReadOpCount | WriteBytes | WriteOpCount | ReadTime | WriteTime
  ContainerReports ::= zero or more ContainerReport
    ContainerReport ::= ContainerID | finalHash | size | used | keyCount |  Name |  LifeCycleState | ContainerIOStats		
      ContainerIOStats ::= readCount| writeCount| readBytes| writeBytes
  ContainerActions ::= ContainerInfo | Action | Reason
  PipelineReport ::= PipelineID | Members | RatisChange | ChangeTimeStamp | EpochID | LogStats | LogFailed
    RatisChange ::= NodeAdded | NodeRemoved | DeadNode | NewLeaderElected | EpochChanged

Sub-Tasks

• Remove SCMNodeAddressList from SCMRegisterRequestProto: Resolved
• Remove ReportState from SCMHeartbeatRequestProto: Resolved
• Remove SendContainerCommand from SCM: Resolved
• Moving ContainerReport inside Datanode heartbeat: Resolved
• Support for DN to SCM signaling: Resolved
• Support for ReportManager in Datanode: Resolved
• Remove ContainerReportManager and ContainerReportManagerImpl: Resolved
• Add Datanode heartbeat dispatcher in SCM: Resolved
• Support in Datanode for sending ContainerActions to SCM: Resolved