Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3630

CompositeRecordReader: key and values can be in uninitialized state if files being joined have no records

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.17.0
    • 0.18.0
    • None
    • None
    • Reviewed

    Description

      I am using org.apache.hadoop.mapred.join.CompositeInputFormat to do an outer-join across a number of SequenceFiles. This works fine in most circumstances, but I get NullPointerExceptions/uninitialized data (where Writable#readFields() has not been called) when some of the files being joined have no records in them.

      Attachments

        1. 3630-1.patch
          7 kB
          Christopher Douglas
        2. 3630-0.patch
          6 kB
          Christopher Douglas

        Activity

          People

            cdouglas Christopher Douglas
            jly Jingkei Ly
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: