Hadoop Common
  1. Hadoop Common
  2. HADOOP-4351

ArrayIndexOutOfBoundsException during fsck

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.18.1
    • Fix Version/s: 0.18.2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      After observing a lot of corrupted blocks, I suddenly started to get a lot of ArrayIndexOutOfBoundsException.

      It appears to be an issue very similar to HADOOP-3649, which is supposed to be fixed in 0.18.1.

      2008-10-06 08:48:43,241 WARN /: /fsck?path=%2F:
      java.lang.ArrayIndexOutOfBoundsException: 2
      at org.apache.hadoop.dfs.FSNamesystem.getBlockLocationsInternal(FSNamesystem.java:789)
      at org.apache.hadoop.dfs.FSNamesystem.getBlockLocations(FSNamesystem.java:727)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:167)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
      at org.apache.hadoop.dfs.NamenodeFsck.check(NamenodeFsck.java:162)
      at org.apache.hadoop.dfs.NamenodeFsck.fsck(NamenodeFsck.java:128)
      at org.apache.hadoop.dfs.FsckServlet.doGet(FsckServlet.java:48)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
      at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
      at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
      at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
      at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
      at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
      at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
      at org.mortbay.http.HttpServer.service(HttpServer.java:954)
      at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
      at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
      at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
      at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
      at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
      at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

      1. arrayIndexOutOfBounds.patch
        8 kB
        Hairong Kuang
      2. arrayIndexOutOfBounds1.patch
        9 kB
        Hairong Kuang
      3. arrayIndexOutOfBounds2.patch
        9 kB
        Hairong Kuang
      4. arrayIndexOutOfBounds3.patch
        10 kB
        Hairong Kuang
      5. arrayIndexOutOfBounds3-br18.patch
        10 kB
        Hairong Kuang
      6. fsck_hadoop_4351.patch
        6 kB
        Brian Bockelman

        Issue Links

          Activity

          Brian Bockelman created issue -
          Brian Bockelman made changes -
          Field Original Value New Value
          Attachment fsck_hadoop_4351.patch [ 12391553 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HADOOP-2065 [ HADOOP-2065 ]
          Hairong Kuang made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          Component/s dfs [ 12310710 ]
          Assignee Hairong Kuang [ hairong ]
          Fix Version/s 0.19.0 [ 12313211 ]
          Fix Version/s 0.18.2 [ 12313424 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds.patch [ 12391862 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds1.patch [ 12391889 ]
          Hairong Kuang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds2.patch [ 12391906 ]
          Hairong Kuang made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hairong Kuang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds3.patch [ 12391911 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds3.patch [ 12391914 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds3.patch [ 12391914 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds3.patch [ 12392040 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds3.patch [ 12391911 ]
          Hairong Kuang made changes -
          Resolution Fixed [ 1 ]
          Hadoop Flags [Reviewed]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hairong Kuang made changes -
          Attachment arrayIndexOutOfBounds3-br18.patch [ 12392042 ]
          Robert Chansler made changes -
          Link This issue is duplicated by HADOOP-4362 [ HADOOP-4362 ]
          Nigel Daley made changes -
          Fix Version/s 0.19.0 [ 12313211 ]
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]

            People

            • Assignee:
              Hairong Kuang
              Reporter:
              Brian Bockelman
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development