Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-461

Container remains in CLOSING state in SCM forever

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.2.1
    • Fix Version/s: 0.2.1
    • Component/s: SCM
    • Labels:
      None
    • Target Version/s:

      Description

      Container id # 13's state is not changing from CLOSING to CLOSED.

      [root@ctr-e138-1518143905142-459606-01-000002 bin]# ./ozone scmcli info 13
      raft.rpc.type = GRPC (default)
      raft.grpc.message.size.max = 33554432 (custom)
      raft.client.rpc.retryInterval = 300 ms (default)
      raft.client.async.outstanding-requests.max = 100 (default)
      raft.client.async.scheduler-threads = 3 (default)
      raft.grpc.flow.control.window = 1MB (=1048576) (default)
      raft.grpc.message.size.max = 33554432 (custom)
      raft.client.rpc.request.timeout = 3000 ms (default)
      Container id: 13
      Container State: OPEN
      Container Path: /tmp/hadoop-root/dfs/data/hdds/de0a9e01-4a12-40e3-b567-51b9bd83248e/current/containerDir0/13/metadata
      Container Metadata:
      LeaderID: ctr-e138-1518143905142-459606-01-000003.hwx.site
      Datanodes: [ctr-e138-1518143905142-459606-01-000007.hwx.site,ctr-e138-1518143905142-459606-01-000008.hwx.site,ctr-e138-1518143905142-459606-01-000003.hwx.site]

       

      snippet of scmcli list :

      {
       "state" : "CLOSING",
       "replicationFactor" : "THREE",
       "replicationType" : "RATIS",
       "allocatedBytes" : 4831838208,
       "usedBytes" : 4831838208,
       "numberOfKeys" : 0,
       "lastUsed" : 4391827471,
       "stateEnterTime" : 5435591457,
       "owner" : "f8332db1-b8b1-4077-a9ea-097033d074b7",
       "containerID" : 13,
       "deleteTransactionId" : 0,
       "containerOpen" : true
      }

        Attachments

        1. all-node-ozone-logs-1536920345.tar.gz
          2.37 MB
          Nilotpal Nandi
        2. HDDS-461.00.patch
          13 kB
          Shashikant Banerjee
        3. HDDS-461.01.patch
          27 kB
          Shashikant Banerjee
        4. HDDS-461.02.patch
          28 kB
          Shashikant Banerjee
        5. HDDS-461.02.patch
          28 kB
          Shashikant Banerjee
        6. HDDS-461.03.patch
          29 kB
          Shashikant Banerjee

          Issue Links

            Activity

              People

              • Assignee:
                shashikant Shashikant Banerjee
                Reporter:
                nilotpalnandi Nilotpal Nandi
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: