Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-2194

Run IndexingFilterChecker as simple Telnet server

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 1.12
    • None
    • None
    • Patch Available

    Description

      We have used a customized IndexingFilterChecker running as server to be able to quickly test/check pages from web applications. I'll add this feature back by letting IndexingFilterChecker run optionally as a simple server.

      Run it with:

      export NUTCH_HEAPSIZE=25 ;  bin/nutch indexchecker -normalize -dumpText -followRedirects -listen 1234

      Then perform a request over TCP:

      echo "http://apache.org/" | nc localhost 1234

      Attachments

        1. NUTCH-2194.patch
          7 kB
          Markus Jelsma
        2. NUTCH-2194.patch
          7 kB
          Markus Jelsma

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. NUTCH-2195 IndexingFilterChecker to optionally follow N redirects

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. NUTCH-2196 IndexingFilterChecker to optionally normalize

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed

          Activity

            People

              markus17 Markus Jelsma
              markus17 Markus Jelsma
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: