Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-529

SequenceFile fails task with NullPointerException in codec initialization

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.6.0
    • 0.6.1
    • None
    • None

    Description

      Sequence file fails in following block of code in 0.6 hadoop ( Sep 13th trunk ) -
      if (decompress) {
      valInFilter = this.codec.createInputStream(valBuffer); ---> throws NullPointerException

      this.codec is apparently not initialized in
      if (version >= CUSTOM_COMPRESS_VERSION && this.decompress) {
      try {
      this.codec = (CompressionCodec) <---- Init code.

      and is used later. It should probably check for version also before using the this.codec.

      2006-09-13 07:37:55,010 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0003_m_001601_0: java.lang.NullPointerException
      at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1001)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:933)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:924)
      at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:37)
      at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:53)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:175)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1066)

      Attachments

        1. seq-file-codec-init.patch
          1 kB
          Owen O'Malley

        Activity

          People

            omalley Owen O'Malley
            sanjay.dahiya Sanjay Dahiya
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: