Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-698

CrawlDb is corrupted after a few crawl cycles

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 1.0.0
    • None
    • None
    • Patch Available

    Description

      After change to hadoop's MapWritable, crawldb becomes corrupted after some fetch cycles. For more details see this discussion thread:

      http://www.nabble.com/Fetcher2-crashes-with-current-trunk-td21978049.html

      Attachments

        1. NUTCH-698_v1.patch
          2 kB
          Dogacan Guney

        Activity

          People

            dogacan Dogacan Guney
            dogacan Dogacan Guney
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: