Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5281

GzipCodec fails second time it is used in a process

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.18.0
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      0.19.0 / Linux / amd64

    • Hadoop Flags:
      Reviewed

      Description

      The attached code (GZt.java) raises:

      java.io.IOException: incorrect header check
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.inflateBytesDirect(Native Method)
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.decompress(ZlibDecompressor.java:221)
      	at org.apache.hadoop.io.compress.DecompressorStream.decompress(DecompressorStream.java:80)
      	at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:74)
      	at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:62)
      	at java.io.DataInputStream.readByte(DataInputStream.java:248)
      	at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:325)
      	at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:346)
      	at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1853)
      	at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1876)
      	at org.apache.hadoop.io.MapFile$Reader.readIndex(MapFile.java:319)
      	at org.apache.hadoop.io.MapFile$Reader.seekInternal(MapFile.java:435)
      	at org.apache.hadoop.io.MapFile$Reader.seekInternal(MapFile.java:417)
      	at org.apache.hadoop.io.MapFile$Reader.seek(MapFile.java:404)
      	at org.apache.hadoop.io.MapFile$Reader.get(MapFile.java:523)
      

        Attachments

        1. 5281-0.patch
          1 kB
          Chris Douglas
        2. 5281-1.patch
          2 kB
          Chris Douglas
        3. 5281-2.patch
          4 kB
          Chris Douglas
        4. GZt.java
          2 kB
          Chris Douglas
        5. GZt.java
          1 kB
          Ben Maurer

          Activity

            People

            • Assignee:
              chris.douglas Chris Douglas
              Reporter:
              bmaurer Ben Maurer
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: