Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13216

Append SequenceFile with compressionType(NONE,RECORD,BLOCK) throws NullPointerException

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.7.2
    • None
    • fs
    • None

    Description

      while Appending sequenceFile with any Compression Type (NONE, RECORD, BLOCK), getting writer

      SequenceFile.createWriter(conf,
      SequenceFile.Writer.file(path),
      SequenceFile.Writer.compression(ctype),
      SequenceFile.Writer.keyClass(Key.class),
      SequenceFile.Writer.valueClass(value..class),
      SequenceFile.Writer.appendIfExists(true),
      );
      Above throws the below exception when we try to append existing sequencefile with some compression technique,
      java.lang.NullPointerException
      at org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:1118)
      at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:273)
      at SequenceFileTest.getWriter(SequenceFileTest.java:342)
      at SequenceFileTest.writeContent(SequenceFileTest.java:429)
      at SequenceFileTest.<init>(SequenceFileTest.java:83)
      at SequenceFileTest.main(SequenceFileTest.java:565)

      If i use below writer
      SequenceFile.createWriter(conf,
      SequenceFile.Writer.file(path),
      SequenceFile.Writer.keyClass(keyClass),
      SequenceFile.Writer.valueClass(keyClass),
      SequenceFile.Writer.appendIfExists(append)
      );
      without any compressiontype, then it works fine.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              syedakram Syed Akram
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: