Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1349

Make batchId explcit within debug logging and improve CLI

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • nutchgora
    • nutchgora
    • indexer
    • None
    • Patch Available

    Description

      I find this a pain when trying to locate the batchId of some urls which are skipped when going to the Solr index. My DEBUG log output gives me

      2012-05-03 20:44:55,268 DEBUG indexer.IndexerJob (IndexerJob.java:map(83)) - Skipping http://www.glasgowwheelers.com/; different batch id
      2012-05-03 20:44:55,259 DEBUG indexer.IndexerJob (IndexerJob.java:map(83)) - Skipping http://www.heraldscotland.com/; different batch id
      

      when I would actually like

      2012-05-03 20:44:55,268 DEBUG indexer.IndexerJob (IndexerJob.java:map(83)) - Skipping http://www.glasgowwheelers.com/; different batch id (ACTUAL BATCH ID)
      2012-05-03 20:44:55,259 DEBUG indexer.IndexerJob (IndexerJob.java:map(83)) - Skipping http://www.heraldscotland.com/; different batch id (ACTUAL BATCH ID)
      

      patch coming up soon

      Attachments

        1. NUTCH-1349-v2.patch
          9 kB
          Lewis John McGibbney
        2. NUTCH-1349-v2.patch
          9 kB
          Lewis John McGibbney
        3. NUTCH-1349.patch
          9 kB
          Lewis John McGibbney

        Activity

          People

            lewismc Lewis John McGibbney
            lewismc Lewis John McGibbney
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: