Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-307

Better handling of partial/truncated input data to parsers

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.4
    • Fix Version/s: None
    • Component/s: parser
    • Labels:
      None

      Description

      Some parsers (e.g. ZipParser) can hang if they prematurely reach the end of the input stream.

      As a way of avoiding this issue, Jukka had suggested the following approach on the list:

      The input stream could be wrapped into a decorator that throws a tagged IOException when the given size limit has been reached. This assumes that all parsers will correctly propagate up an IOException (at the very least).

      Smarter parsers could cleanly close the emitted XHTML stream, potentially adding a metadata entry that signifies that the extracted text has been truncated.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                kkrugler Ken Krugler
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: