Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-3017

Allow fast-urlfilter to load from HDFS/S3 and support gzipped input

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Implemented
    • 1.19
    • 1.20
    • plugin, urlfilter
    • None
    • Patch Available

    Description

      This provide an easier way to refresh the resources since no rebuild of the jar will be needed. The path can point to either HDFS or S3. Additionally, .gz files should be handled automatically

      Attachments

        Activity

          People

            Unassigned Unassigned
            jnioche Julien Nioche
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: