Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13575 RBF: Track Router state
  3. HDFS-13198

RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.0, 2.10.0, 2.9.1, 3.0.3
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Exception looks like:

      2018-02-23 19:04:56,341 ERROR router.RouterHeartbeatService: Cannot get version for class org.apache.hadoop.hdfs.server.federation.store.MembershipStore: Cached State Store not initialized, MembershipState records not valid
      2018-02-23 19:04:56,341 ERROR router.RouterHeartbeatService: Cannot get version for class org.apache.hadoop.hdfs.server.federation.store.MountTableStore: Cached State Store not initialized, MountTable records not valid
      Exception in thread "Router Heartbeat Async" java.lang.NullPointerException
      at org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializableImpl.serialize(StateStoreSerializableImpl.java:60)
      at org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl.putAll(StateStoreZooKeeperImpl.java:191)
      at org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreBaseImpl.put(StateStoreBaseImpl.java:75)
      at org.apache.hadoop.hdfs.server.federation.store.impl.RouterStoreImpl.routerHeartbeat(RouterStoreImpl.java:88)
      at org.apache.hadoop.hdfs.server.federation.router.RouterHeartbeatService.updateStateStore(RouterHeartbeatService.java:95)
      at org.apache.hadoop.hdfs.server.federation.router.RouterHeartbeatService.access$000(RouterHeartbeatService.java:43)
      at org.apache.hadoop.hdfs.server.federation.router.RouterHeartbeatService$1.run(RouterHeartbeatService.java:68)
      at java.lang.Thread.run(Thread.java:748)

      This is because, during starting the Router, the CachedStateStore hasn't been initialized and cannot serve requests. Although the router will still be started, it would be better to fix the exceptions.

        Attachments

        1. HDFS-13198.000.patch
          2 kB
          Wei Yan
        2. HDFS-13198.001.patch
          6 kB
          Wei Yan
        3. HDFS-13198.002.patch
          9 kB
          Wei Yan
        4. HDFS-13198.003.patch
          9 kB
          Wei Yan
        5. HDFS-13198.004.patch
          9 kB
          Wei Yan
        6. HDFS-13198.005.patch
          9 kB
          Wei Yan

          Activity

            People

            • Assignee:
              ywskycn Wei Yan
              Reporter:
              ywskycn Wei Yan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: