Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13575 RBF: Track Router state
  3. HDFS-13198

RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.1.0, 2.10.0, 2.9.1, 3.0.3
    • None
    • None
    • Reviewed

    Description

      Exception looks like:

      2018-02-23 19:04:56,341 ERROR router.RouterHeartbeatService: Cannot get version for class org.apache.hadoop.hdfs.server.federation.store.MembershipStore: Cached State Store not initialized, MembershipState records not valid
      2018-02-23 19:04:56,341 ERROR router.RouterHeartbeatService: Cannot get version for class org.apache.hadoop.hdfs.server.federation.store.MountTableStore: Cached State Store not initialized, MountTable records not valid
      Exception in thread "Router Heartbeat Async" java.lang.NullPointerException
      at org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializableImpl.serialize(StateStoreSerializableImpl.java:60)
      at org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl.putAll(StateStoreZooKeeperImpl.java:191)
      at org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreBaseImpl.put(StateStoreBaseImpl.java:75)
      at org.apache.hadoop.hdfs.server.federation.store.impl.RouterStoreImpl.routerHeartbeat(RouterStoreImpl.java:88)
      at org.apache.hadoop.hdfs.server.federation.router.RouterHeartbeatService.updateStateStore(RouterHeartbeatService.java:95)
      at org.apache.hadoop.hdfs.server.federation.router.RouterHeartbeatService.access$000(RouterHeartbeatService.java:43)
      at org.apache.hadoop.hdfs.server.federation.router.RouterHeartbeatService$1.run(RouterHeartbeatService.java:68)
      at java.lang.Thread.run(Thread.java:748)

      This is because, during starting the Router, the CachedStateStore hasn't been initialized and cannot serve requests. Although the router will still be started, it would be better to fix the exceptions.

      Attachments

        1. HDFS-13198.005.patch
          9 kB
          Wei Yan
        2. HDFS-13198.004.patch
          9 kB
          Wei Yan
        3. HDFS-13198.003.patch
          9 kB
          Wei Yan
        4. HDFS-13198.002.patch
          9 kB
          Wei Yan
        5. HDFS-13198.001.patch
          6 kB
          Wei Yan
        6. HDFS-13198.000.patch
          2 kB
          Wei Yan

        Activity

          People

            ywskycn Wei Yan
            ywskycn Wei Yan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: