Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-813

Repetitive crawl 403 status page

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • 1.1
    • 1.7
    • None
    • None
    • Patch Available

    Description

      When we crawl a page the return a 403 status. It will be crawl repetitively each days with default schedule.
      Even when we restrict by paramter db.fetch.retry.max

      Attachments

        1. ASF.LICENSE.NOT.GRANTED--Patch
          0.5 kB
          Tien Nguyen Manh

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. NUTCH-578 URL fetched with 403 is generated over and over again

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              Unassigned Unassigned
              tiennm Tien Nguyen Manh
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: