Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-965

Skip parsing for truncated documents

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • nutchgora, 1.5
    • parser
    • None
    • Patch Available

    Description

      The issue you're likely to run into when parsing truncated FLV files is described here:
      http://www.mail-archive.com/user@nutch.apache.org/msg01880.html

      The parser library gets stuck in infinite loop as it encounters corrupted data due to for example truncating big binary files at fetch time.

      Attachments

        1. NUTCH-965-v2.patch
          3 kB
          Lewis John McGibbney
        2. NUTCH-965-v3-nutchgora.txt
          6 kB
          Ferdy
        3. NUTCH-965-v3-trunk.txt
          7 kB
          Ferdy
        4. parserJob.patch
          1 kB
          Alexis

        Activity

          People

            lewismc Lewis John McGibbney
            alexis779 Alexis
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: