[HADOOP-4351] ArrayIndexOutOfBoundsException during fsck

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.18.1
• Fix Version/s: 0.18.2
• Hadoop Flags: Reviewed
• Assignee: Hairong Kuang
• Reporter: Brian Bockelman
• Created: 06/Oct/08 14:12
• Updated: 08/Jul/09 16:43
• Resolved: 13/Oct/08 21:54

Description

After observing a lot of corrupted blocks, I suddenly started to get a lot of ArrayIndexOutOfBoundsException.

It appears to be an issue very similar to HADOOP-3649, which is supposed to be fixed in 0.18.1.

2008-10-06 08:48:43,241 WARN /: /fsck?path=%2F:
java.lang.ArrayIndexOutOfBoundsException: 2
at org.apache.hadoop.dfs.FSNamesystem.getBlockLocationsInternal(FSNamesystem.java:789)
at org.apache.hadoop.dfs.FSNamesystem.getBlockLocations(FSNamesystem.java:727)
at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:167)
at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
at org.apache.hadoop.dfs.NamenodeFsck.fsck(NamenodeFsck.java:128)
at org.apache.hadoop.dfs.FsckServlet.doGet(FsckServlet.java:48)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
at org.mortbay.http.HttpServer.service(HttpServer.java:954)
at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

Issue Links

• is duplicated by: HADOOP-4362 Hadoop Streaming failed with large number of input files
• is related to: HADOOP-2065 Replication policy for corrupted block