Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-7759 Improve Ozone Replication Manager
  3. HDDS-8187

ReplicationManager: Datanode commands should be sent to nodeManager directly

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Done
    • None
    • 1.4.0
    • SCM

    Description

      In order to keep a consistent count of the number of pending replicate and delete commands, ReplicationManager should send commands to the datanode via the nodeManager.addDatanodeCommand() method rather than publishing them to the event queue.

      At the moment, the commands goto the event queue, where they are picked up by NodeManager and added to the datanode command queue. As we are using the counts in the command queue to determine how many commands are pending, the indirection provided by the event queue makes it difficult to keep a consistent count without excessive effort.

      There is also no further processing done on the commands in the event queue, they simply go RM -> Event Queue -> Node Manager -> Command Queue.

      This change makes RM send the commands to nodeManager directly.

      Attachments

        Issue Links

          Activity

            People

              sodonnell Stephen O'Donnell
              sodonnell Stephen O'Donnell
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: