Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14280

Bulk Upload from HA cluster to remote HA hbase cluster fails

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Patch will effectively work with Hadoop version 2.6 or greater with a launch of "internal.nameservices".
      There will be no change in versions older than 2.6.
      Show
      Patch will effectively work with Hadoop version 2.6 or greater with a launch of "internal.nameservices". There will be no change in versions older than 2.6.
    • Tags:
      bulkupload
    • Flags:
      Patch

      Description

      Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(java.io.IOException): java.io.IOException: Wrong FS: hdfs://ha-aggregation-nameservice1/hbase_upload/82c89692-6e78-46ef-bbea-c9e825318bfe/A/1aaaa31358d641c69d6c34b803c187b0, expected: hdfs://ha-hbase-nameservice1
      at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2113)
      at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
      at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114)
      at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.IllegalArgumentException: Wrong FS: hdfs://ha-aggregation-nameservice1/hbase_upload/82c89692-6e78-46ef-bbea-c9e825318bfe/A/1aaaa31358d641c69d6c34b803c187b0, expected: hdfs://ha-hbase-nameservice1
      at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:645)
      at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:193)
      at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:105)
      at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1136)
      at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1132)
      at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1132)
      at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:414)
      at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1423)
      at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.commitStoreFile(HRegionFileSystem.java:372)
      at org.apache.hadoop.hbase.regionserver.HRegionFileSystem.bulkLoadStoreFile(HRegionFileSystem.java:451)
      at org.apache.hadoop.hbase.regionserver.HStore.bulkLoadHFile(HStore.java:750)
      at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4894)
      at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4799)
      at org.apache.hadoop.hbase.regionserver.HRegionServer.bulkLoadHFile(HRegionServer.java:3377)
      at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29996)
      at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2078)
      ... 4 more

      at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1498)
      at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1684)
      at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1737)
      at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.bulkLoadHFile(ClientProtos.java:29276)
      at org.apache.hadoop.hbase.protobuf.ProtobufUtil.bulkLoadHFile(ProtobufUtil.java:1548)
      ... 11 more

        Attachments

        1. 14280-v5.patch
          2 kB
          Ankit Singhal
        2. 14280-v4.patch
          2 kB
          Ted Yu
        3. HBASE-14280_v3.patch
          3 kB
          Ankit Singhal
        4. HBASE-14280_v2.patch
          3 kB
          Ankit Singhal
        5. HBASE-14280_v1.0.patch
          3 kB
          Ankit Singhal

          Activity

            People

            • Assignee:
              ankit.singhal Ankit Singhal
              Reporter:
              ankit.singhal Ankit Singhal
            • Votes:
              2 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: