Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-523

TextInputformat .isSplittable() fails with NullPointerException with hadoop 0.6.1

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.6.0
    • 0.6.1
    • None
    • None

    Description

      With hadoop 0.6.1, TextInputFormat fails with NullPointerException, causing Job with fail.

      TextInputFormat.configure() is not called to initialize compressionCodecs and following method throws NullPointerException.

      protected boolean isSplitable(FileSystem fs, Path file)

      { return compressionCodecs.getCodec(file) == null; }

      java.lang.NullPointerException
      at org.apache.hadoop.mapred.TextInputFormat.isSplitable(TextInputFormat.java:37)
      at org.apache.hadoop.mapred.InputFormatBase.getSplits(InputFormatBase.java:149)
      at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:129)
      at org.apache.hadoop.mapred.JobTracker$JobInitThread.run(JobTracker.java:314)
      at java.lang.Thread.run(Thread.java:613)

      Attachments

        1. test-configure-input-format.patch
          0.6 kB
          Owen O'Malley
        2. configure-input-format.patch
          1 kB
          Owen O'Malley

        Activity

          People

            omalley Owen O'Malley
            sanjay.dahiya Sanjay Dahiya
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: