Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4351

ArrayIndexOutOfBoundsException during fsck

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.18.1
    • 0.18.2
    • None
    • None
    • Reviewed

    Description

      After observing a lot of corrupted blocks, I suddenly started to get a lot of ArrayIndexOutOfBoundsException.

      It appears to be an issue very similar to HADOOP-3649, which is supposed to be fixed in 0.18.1.

      2008-10-06 08:48:43,241 WARN /: /fsck?path=%2F:
      java.lang.ArrayIndexOutOfBoundsException: 2
      at org.apache.hadoop.dfs.FSNamesystem.getBlockLocationsInternal(FSNamesystem.java:789)
      at org.apache.hadoop.dfs.FSNamesystem.getBlockLocations(FSNamesystem.java:727)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:167)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
      at org.apache.hadoop.dfs.NamenodeFsck.fsck(NamenodeFsck.java:128)
      at org.apache.hadoop.dfs.FsckServlet.doGet(FsckServlet.java:48)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
      at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
      at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
      at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
      at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
      at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
      at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
      at org.mortbay.http.HttpServer.service(HttpServer.java:954)
      at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
      at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
      at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
      at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
      at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
      at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

      Attachments

        1. fsck_hadoop_4351.patch
          6 kB
          Brian Bockelman
        2. arrayIndexOutOfBounds3-br18.patch
          10 kB
          Hairong Kuang
        3. arrayIndexOutOfBounds3.patch
          10 kB
          Hairong Kuang
        4. arrayIndexOutOfBounds2.patch
          9 kB
          Hairong Kuang
        5. arrayIndexOutOfBounds1.patch
          9 kB
          Hairong Kuang
        6. arrayIndexOutOfBounds.patch
          8 kB
          Hairong Kuang

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            hairong Hairong Kuang
            bockelman Brian Bockelman
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment