Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-2719

NPE if exchanges.xml uses index writer not available

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.15
    • 1.16
    • indexer
    • None

    Description

      If the exchanges.xml uses an index writer not present (e.g., because the plugin is not in plugin.includes) the index job fails with a NPE:

      java.lang.Exception: java.lang.NullPointerException
              at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
              at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
      Caused by: java.lang.NullPointerException
              at org.apache.nutch.indexer.IndexWriters.write(IndexWriters.java:222)
              at org.apache.nutch.indexer.IndexerOutputFormat$1.write(IndexerOutputFormat.java:62)
              at org.apache.nutch.indexer.IndexerOutputFormat$1.write(IndexerOutputFormat.java:47)
              at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:558)
      

      This should be caught gracefully with a message about an inconsistent configuration.

      Attachments

        Issue Links

          Activity

            People

              roannel Roannel Fernández Hernández
              snagel Sebastian Nagel
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: