Nutch
  1. Nutch
  2. NUTCH-1197

Add statically configured field values to solrindex-mapping.xml

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: indexer
    • Labels:
      None

      Description

      In some cases it's useful to be able to add to every document sent to Solr a set of predefined fields with static values. This could be implemented on the Solr side (with a custom UpdateRequestProcessor), but it may be less cumbersome to add them on the Nutch side.

      Example: let's say I have several Nutch configurations all indexing to the same Solr instance, and I want each of them to add its identifier as a field in all documents, e.g. "origin"="web_crawl_1", "origin"="file_crawl", "origin"="unlimited_crawl", etc...

      1. NUTCH-1197.patch
        9 kB
        Andrzej Bialecki

        Issue Links

          Activity

          Lewis John McGibbney made changes -
          Fix Version/s 1.11 [ 12329358 ]
          Peter Ciuffetti made changes -
          Link This issue is related to NUTCH-2052 [ NUTCH-2052 ]
          Julien Nioche made changes -
          Assignee Julien Nioche [ jnioche ]
          Lewis John McGibbney made changes -
          Fix Version/s 1.11 [ 12329358 ]
          Fix Version/s 1.10 [ 12327187 ]
          Julien Nioche made changes -
          Fix Version/s 1.10 [ 12327187 ]
          Fix Version/s 1.9 [ 12324611 ]
          Julien Nioche made changes -
          Assignee Andrzej Bialecki [ ab ] Julien Nioche [ jnioche ]
          Lewis John McGibbney made changes -
          Fix Version/s 1.9 [ 12324611 ]
          Fix Version/s 1.7 [ 12323281 ]
          Lewis John McGibbney made changes -
          Fix Version/s 1.7 [ 12323281 ]
          Fix Version/s 1.6 [ 12319941 ]
          Markus Jelsma made changes -
          Fix Version/s 1.6 [ 12319941 ]
          Fix Version/s 1.5 [ 12318246 ]
          Hide
          Markus Jelsma added a comment -

          20120304-push-1.6

          Show
          Markus Jelsma added a comment - 20120304-push-1.6
          Chris A. Mattmann made changes -
          Fix Version/s 1.5 [ 12318246 ]
          Fix Version/s 1.4 [ 12316519 ]
          Hide
          Chris A. Mattmann added a comment -
          • push out.
          Show
          Chris A. Mattmann added a comment - push out.
          Andrzej Bialecki made changes -
          Field Original Value New Value
          Attachment NUTCH-1197.patch [ 12502232 ]
          Hide
          Andrzej Bialecki added a comment -

          Patch with the implementation. I added some javadocs, and a unit test for both the old and the new functionality.

          Show
          Andrzej Bialecki added a comment - Patch with the implementation. I added some javadocs, and a unit test for both the old and the new functionality.
          Andrzej Bialecki created issue -

            People

            • Assignee:
              Unassigned
              Reporter:
              Andrzej Bialecki
            • Votes:
              1 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Development