Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-461

Container remains in CLOSING state in SCM forever

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.2.1
    • 0.2.1
    • SCM
    • None

    Description

      Container id # 13's state is not changing from CLOSING to CLOSED.

      [root@ctr-e138-1518143905142-459606-01-000002 bin]# ./ozone scmcli info 13
      raft.rpc.type = GRPC (default)
      raft.grpc.message.size.max = 33554432 (custom)
      raft.client.rpc.retryInterval = 300 ms (default)
      raft.client.async.outstanding-requests.max = 100 (default)
      raft.client.async.scheduler-threads = 3 (default)
      raft.grpc.flow.control.window = 1MB (=1048576) (default)
      raft.grpc.message.size.max = 33554432 (custom)
      raft.client.rpc.request.timeout = 3000 ms (default)
      Container id: 13
      Container State: OPEN
      Container Path: /tmp/hadoop-root/dfs/data/hdds/de0a9e01-4a12-40e3-b567-51b9bd83248e/current/containerDir0/13/metadata
      Container Metadata:
      LeaderID: ctr-e138-1518143905142-459606-01-000003.hwx.site
      Datanodes: [ctr-e138-1518143905142-459606-01-000007.hwx.site,ctr-e138-1518143905142-459606-01-000008.hwx.site,ctr-e138-1518143905142-459606-01-000003.hwx.site]

       

      snippet of scmcli list :

      {
       "state" : "CLOSING",
       "replicationFactor" : "THREE",
       "replicationType" : "RATIS",
       "allocatedBytes" : 4831838208,
       "usedBytes" : 4831838208,
       "numberOfKeys" : 0,
       "lastUsed" : 4391827471,
       "stateEnterTime" : 5435591457,
       "owner" : "f8332db1-b8b1-4077-a9ea-097033d074b7",
       "containerID" : 13,
       "deleteTransactionId" : 0,
       "containerOpen" : true
      }

      Attachments

        1. all-node-ozone-logs-1536920345.tar.gz
          2.37 MB
          Nilotpal Nandi
        2. HDDS-461.00.patch
          13 kB
          Shashikant Banerjee
        3. HDDS-461.01.patch
          27 kB
          Shashikant Banerjee
        4. HDDS-461.02.patch
          28 kB
          Shashikant Banerjee
        5. HDDS-461.02.patch
          28 kB
          Shashikant Banerjee
        6. HDDS-461.03.patch
          29 kB
          Shashikant Banerjee

        Issue Links

          Activity

            People

              shashikant Shashikant Banerjee
              nilotpalnandi Nilotpal Nandi
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: