Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-11844

Ozone: Recover SCM state when SCM is restarted

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • ozone, scm
    • None

    Description

      SCM losses its state once being restarted. This issue can be found by a simple test with following steps

      1. Start NN, DN, SCM
      2. Create several containers via SCM CLI
      3. Restart DN
      4. Get existing container info via SCM CLI, this step will fail with container doesn't exist error.

      ContainerManagerImpl maintains a cache of container mapping containerMap, if DN is restarted, this information is lost. We need a way to restore the state from DB in a background thread.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HDFS-12016 Ozone: SCM: Container metadata are not loaded properly after datanode restart

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              aengineer Anu Engineer
              cheersyang Weiwei Yang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: