[HBASE-9160] TestNamespaceUpgrade fails on hadoop 2.1 due to existence of .snapshot directory in tar ball

• Type: Test
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.98.0, 0.95.2
• Component/s: test
• Hadoop Flags: Reviewed
• Assignee: Francis Christopher Liu
• Reporter: Ted Yu
• Created: 08/Aug/13 20:07
• Updated: 23/Sep/13 19:22
• Resolved: 14/Aug/13 06:11

Description

Here is partial listing of contents for TestNamespaceUpgrade.tgz :

-rwxrwxrwx  0 fcliu  staff       0 May 13 10:50 hbase/.snapshot/ns.two.foo_snapshot2/7112077ccfba8a46c0694ca8c0a4bc2d/f/136799c89e244b9bad79281b37650927
-rwxrwxrwx  0 fcliu  staff       0 May 13 10:50 hbase/.snapshot/ns.two.foo_snapshot2/7112077ccfba8a46c0694ca8c0a4bc2d/f/98093488150c42229927fd2a1e8c5d69
-rw-r--r--  0 fcliu  staff      12 May 13 10:50 hbase/.snapshot/ns.two.foo_snapshot1/..snapshotinfo.crc

Running the test on hadoop 2.1, I saw the following in test output:

2013-08-08 19:59:29,834 WARN  [IPC Server handler 3 on 47143] ipc.Server$Handler(2044): IPC Server handler 3 on 47143, call org.apache.hadoop.hdfs.protocol.ClientProtocol.mkdirs from 127.0.0.1:46287 Call#264 Retry#0: error: org.apache.hadoop.HadoopIllegalArgumentException: ".snapshot" is a reserved name.
org.apache.hadoop.HadoopIllegalArgumentException: ".snapshot" is a reserved name.
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.verifyINodeName(FSDirectory.java:2108)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:2204)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedMkdir(FSDirectory.java:2003)
        at org.apache.hadoop.hdfs.server.namenode.FSDirectory.mkdirs(FSDirectory.java:1956)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:3379)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:3338)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3310)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:694)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:502)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:48089)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2028)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2024)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2022)
put: ".snapshot" is a reserved name.

Looks like the tar ball was generated using an old version of 0.94

Issue Links

• relates to: HBASE-8408 Implement namespace