Nutch
  1. Nutch
  2. NUTCH-1258

MoreIndexingFilter should be able to read Content-Type from both parse metadata and content metadata

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4
    • Fix Version/s: 1.5
    • Component/s: indexer
    • Labels:
      None
    • Patch Info:
      Patch Available

      Description

      The MoreIndexingFilter reads the Content-Type from parse metadata. However, this usually contains a lot of crap because web developers can set it to anything they like. The filter must be able to read the Content-Type field from content metadata as well because that contains the type detected by Tika's Detector.

      1. NUTCH-1258-v2.patch
        2 kB
        Julien Nioche
      2. NUTCH-1258-1.5-1.patch
        2 kB
        Markus Jelsma

        Issue Links

          Activity

          Markus Jelsma created issue -
          Markus Jelsma made changes -
          Field Original Value New Value
          Attachment NUTCH-1258-1.5-1.patch [ 12511826 ]
          Markus Jelsma made changes -
          Link This issue relates to NUTCH-1259 [ NUTCH-1259 ]
          Markus Jelsma made changes -
          Priority Major [ 3 ] Minor [ 4 ]
          Markus Jelsma made changes -
          Patch Info Patch Available [ 10042 ]
          Julien Nioche made changes -
          Attachment NUTCH-1258-v2.patch [ 12514342 ]
          Markus Jelsma made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Lewis John McGibbney made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Markus Jelsma
              Reporter:
              Markus Jelsma
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development