Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9247

NM fails to start when downgrading from 3.x to 2.7

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.2
    • Fix Version/s: None
    • Component/s: yarn
    • Labels:
      None

      Description

      NM will throws java.io.IOException: Unexpected container state key when downgrading from 3.1.3 to 2.7.2 duo to starttime added by hadoop3.x is not known by old version.

      2019-01-28 12:12:05,227 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
      org.apache.hadoop.service.ServiceStateException: java.io.IOException: Unexpected container state key: ContainerManager/containers/container_e42_1548641704310_0002_01_000001/starttime
              at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
              at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
              at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
              at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:263)
              at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
              at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:536)
              at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:584)
      Caused by: java.io.IOException: Unexpected container state key: ContainerManager/containers/container_e42_1548641704310_0002_01_000001/starttime
              at org.apache.hadoop.yarn.server.nodemanager.recovery.NMLeveldbStateStoreService.loadContainerState(NMLeveldbStateStoreService.java:242)
              at org.apache.hadoop.yarn.server.nodemanager.recovery.NMLeveldbStateStoreService.loadContainersState(NMLeveldbStateStoreService.java:178)
              at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.recover(ContainerManagerImpl.java:290)
              at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:274)
              at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
              ... 5 more
      

        Attachments

          Activity

            People

            • Assignee:
              yangjiandan Jiandan Yang
              Reporter:
              yangjiandan Jiandan Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: