[HADOOP-7629] regression with MAPREDUCE-2289 - setPermission passed immutable FsPermission (rpc failure)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.22.0
• Fix Version/s: 1.1.0, 0.23.0
• Hadoop Flags: Reviewed
• Assignee: Todd Lipcon
• Reporter: Patrick D. Hunt
• Created: 09/Sep/11 17:45
• Updated: 15/Nov/11 00:50
• Resolved: 14/Sep/11 06:51

Description

MAPREDUCE-2289 introduced the following change:

+        fs.setPermission(stagingArea, JOB_DIR_PERMISSION);

JOB_DIR_PERMISSION is an immutable FsPermission which cannot be used in RPC calls, it results in the following exception:

2011-09-08 16:31:45,187 WARN org.apache.hadoop.ipc.Server: Unable to read call parameters for client 127.0.0.1
java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.fs.permission.FsPermission$2.<init>()
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
        at org.apache.hadoop.io.WritableFactories.newInstance(WritableFactories.java:53)
        at org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:236)
        at org.apache.hadoop.ipc.RPC$Invocation.readFields(RPC.java:104)
        at org.apache.hadoop.ipc.Server$Connection.processData(Server.java:1337)
        at org.apache.hadoop.ipc.Server$Connection.processOneRpc(Server.java:1315)
        at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1215)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:566)
        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:363)
Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.fs.permission.FsPermission$2.<init>()
        at java.lang.Class.getConstructor0(Class.java:2706)
        at java.lang.Class.getDeclaredConstructor(Class.java:1985)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:109)
        ... 8 more

Issue Links

• is broken by: MAPREDUCE-2289 Permissions race can make getStagingDir fail on local filesystem
• is related to: HDFS-2332 Add test for HADOOP-7629: using an immutable FsPermission as an IPC parameter