Nutch
  1. Nutch
  2. NUTCH-1258

MoreIndexingFilter should be able to read Content-Type from both parse metadata and content metadata

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4
    • Fix Version/s: 1.5
    • Component/s: indexer
    • Labels:
      None
    • Patch Info:
      Patch Available

      Description

      The MoreIndexingFilter reads the Content-Type from parse metadata. However, this usually contains a lot of crap because web developers can set it to anything they like. The filter must be able to read the Content-Type field from content metadata as well because that contains the type detected by Tika's Detector.

      1. NUTCH-1258-1.5-1.patch
        2 kB
        Markus Jelsma
      2. NUTCH-1258-v2.patch
        2 kB
        Julien Nioche

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Markus Jelsma
              Reporter:
              Markus Jelsma
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development