[HADOOP-68] "Cannot abandon block during write to <file>" and "Cannot obtain additional block for file <file>" errors during dfs write test

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.0
• Fix Version/s: 0.2.0

Environment

linux 2.6, redhat, 180 machines

• Assignee: Owen O'Malley
• Reporter: Owen O'Malley
• Created: 08/Mar/06 08:11
• Updated: 08/Jul/09 16:41
• Resolved: 22/Apr/06 00:23

Description

In the namenode's log file, when trying to run my writer benchmark, I get a bunch of messages like:

060307 112402 Server handler 2 on 9020 call error: java.io.IOException: Cannot a
bandon block during write to /user/oom/random/.part001389.crc
java.io.IOException: Cannot abandon block during write to /user/oom/random/.part
001389.crc
at org.apache.hadoop.dfs.NameNode.abandonBlock(NameNode.java:188)
at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
sorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.ipc.RPC$1.call(RPC.java:208)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:200)

and

060307 112402 Server handler 1 on 9020 call error: java.io.IOException: Cannot a
bandon block during write to /user/oom/random/part001695
java.io.IOException: Cannot abandon block during write to /user/oom/random/part0
01695
at org.apache.hadoop.dfs.NameNode.abandonBlock(NameNode.java:188)
at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
sorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.ipc.RPC$1.call(RPC.java:208)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:200)

and

060307 112402 Server handler 2 on 9020 call error: java.io.IOException: Cannot obtain additional block for file /user/oom/random/part001274
java.io.IOException: Cannot obtain additional block for file /user/oom/random/pa
rt001274
at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:160)
at sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
sorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.ipc.RPC$1.call(RPC.java:208)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:200)