[HBASE-9825] LoadIncrementalHFiles fails to load from remote cluster in hadoop 2

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.94.12
• Component/s: hadoop2
• Assignee: Unassigned
• Reporter: Jerry He
• Created: 23/Oct/13 04:12
• Updated: 16/Jun/22 18:23
• Resolved: 28/Oct/13 04:55

Description

Running on hadoop 2, LoadIncrementalHFiles gives the following exception when loading from a remote cluster.

org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@455e455e, java.io.IOException: j ava.io.IOException: java.lang.UnsupportedOperationException: Immutable Configuration
        at org.apache.hadoop.hbase.regionserver.CompoundConfiguration.setClass(CompoundConfiguration.java:516)
        at org.apache.hadoop.ipc.RPC.setProtocolEngine(RPC.java:195)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNNProxyWithClientProtocol(NameNodeProxies.java:250)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:169)
        at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:130)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:482)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:445)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:136)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2429)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:88)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2463)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2445)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:363)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:283)
        at org.apache.hadoop.hbase.regionserver.Store.assertBulkLoadHFileOk(Store.java:571)
        at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:3689)
        at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:3637)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.bulkLoadHFiles(HRegionServer.java:2939)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
        at java.lang.reflect.Method.invoke(Method.java:611)
        at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:320)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
        at org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:186)
        at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.tryAtomicRegionLoad(LoadIncrementalHFiles.java:567)
        at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$1.call(LoadIncrementalHFiles.java:317)
        at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$1.call(LoadIncrementalHFiles.java:315)

This does not happen when loading from the same FileSystem.

Issue Links

• is related to: HBASE-8347 TestSecureLoadInc* tests hang repeatedly getting UnsupportedOperationException in hadoop2 profile
• is related to: HBASE-8372 Provide mutability to CompoundConfiguration
• is related to: HBASE-9819 Backport HBASE-8372 'Provide mutability to CompoundConfiguration' to 0.94