Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1334

NPE in FetcherOutputFormat

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.7
    • None
    • None
    • Patch Available

    Description

      If fetcher.parse or fetcher.store.content are set to false AND the write method receives an instance of Parse or Content, a NPE will be thrown.
      This usually does not happen as the Fetcher does not output a Parse or Content based on the configuration, however this class is also used by the ArcSegmentCreator which is unaware of these parameters and will output a Parse or Content instance regardless of the configuration. One option would be to make the ArcSegmentCreator aware of the fetcher.* parameters and output things accordingly but it also makes sense to modify the FetcherOutputFormat so that it checks whether a subWriter has been created before trying to use it.

      Attachments

        1. NUTCH-1334.patch
          0.7 kB
          Julien Nioche

        Activity

          People

            Unassigned Unassigned
            jnioche Julien Nioche
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: