Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1035

StackOverflowError in FSDataSet

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.10.1, 0.11.0, 0.11.1, 0.11.2
    • 0.12.1
    • None
    • None

    Description

      [hadoop.org.apache.hadoop.dfs.DataNode] DataXCeiver
      java.lang.StackOverflowError
      at java.nio.ByteBuffer.wrap([BII)Ljava.nio.ByteBuffer;(Unknown Source)
      at java.nio.ByteBuffer.wrap([B)Ljava.nio.ByteBuffer;(Unknown Source)
      at java.lang.StringCoding$CharsetSE.encode([CII)[B(Unknown Source)
      at java.lang.StringCoding.encode(Ljava.lang.String;[CII)[B(Unknown Source)
      at java.lang.String.getBytes(Ljava.lang.String[B(Unknown Source)
      at java.io.UnixFileSystem.rename0(Ljava.io.File;Ljava.io.File;)Z(Native Method)
      at java.io.UnixFileSystem.rename(UnixFileSystem.java:265)
      at java.io.File.renameTo(File.java:1192)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:89)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:105)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:95)

      I do not have the end of the stacktrace, but it is sure it happens in DataNode.DataXceiver.writeBlock().

      This error occurs after applying the patch provided in HADOOP-1034 that permits to see such exceptions in log files.

      Attachments

        1. HADOOP-1035-1.patch
          5 kB
          Raghu Angadi
        2. HADOOP-1035-2.patch
          7 kB
          Raghu Angadi
        3. HADOOP-1035-3.patch
          7 kB
          Raghu Angadi
        4. patch-StackOverflowError-HADOOP-1035
          4 kB
          Philippe Gassmann

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rangadi Raghu Angadi
            phil@anyware-tech.com Philippe Gassmann
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment