Uploaded image for project: 'Hadoop Distributed Data Store'
  1. Hadoop Distributed Data Store
  2. HDDS-1561

Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove

    XMLWordPrintableJSON

    Details

    • Target Version/s:

      Description

      Right now, if a pipeline is destroyed by SCM, all the container on the pipeline are marked as quasi closed when datanode received close container command. SCM while processing these containers reports, marks these containers as closed once majority of the nodes are available.

      This is however not a sufficient condition in cases where the raft log directory is missing or corrupted. As the containers will not have all the applied transaction.
      To solve this problem, we should QUASI_CLOSE the containers in datanode as part of ratis groupRemove. If a container is in OPEN state in datanode without any active pipeline, it will be marked as Unhealthy while processing close container command.

      cc Jitendra Nath Pandey, Shashikant Banerjee, Supratim Deka, [~nandakumar131]

        Attachments

        1. HDDS-1561.001.patch
          27 kB
          Lokesh Jain

          Issue Links

            Activity

              People

              • Assignee:
                ljain Lokesh Jain
                Reporter:
                msingh Mukul Kumar Singh
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m