Tika
  1. Tika
  2. TIKA-1132

Parsing some XLS documents hangs entire JVM, requires kill -9

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.2, 1.3
    • Fix Version/s: 1.5
    • Component/s: parser
    • Labels:
      None
    • Environment:

      Description

      Some XLS documents hang the entire JVM. A control-C or regular kill won't stop the JVM, a kill -9 is required.

      We're running within an email server application parsing documents to extract text of all attachments. When we hit a message with the affected attachment the entire JVM hangs and we mark the message to skip extracting the text from the affected message the next attempt. Unfortunately, it kills all email processing on the server until the internal watchdogs kill -9 the application.

      We have seen the issue for several months with different documents, but they are always Excel files. Some get complaints from Excel when opening but not all.

      In addition to experiencing the problem on our Linux servers I have tested on OSX and experienced the same problems. I ran the Tika UI and select the affected file or run the CLI. The problem is the same.
      Tested with java -jar /path/to/tika-app-1.3.jar -t /path/to/file.xls

      When running on multi-CPU machines there are two threads running at 100% every time.

      I have attached a document that triggers the error.

      I have tested with 1.2 and 1.3 with the same result. Running 1.1 the text is accurately extracted.

      1. mod3.xlsx
        25 kB
        Ryan Krueger
      2. mod.xls
        36 kB
        Ryan Krueger

        Activity

        Jukka Zitting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Tim Allison made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Tim Allison made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Assignee Tim Allison [ tallison@mitre.org ]
        Tim Allison made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 1.5 [ 12324552 ]
        Fix Version/s 1.1 [ 12318849 ]
        Resolution Fixed [ 1 ]
        Ryan Krueger made changes -
        Attachment mod3.xlsx [ 12587338 ]
        Ryan Krueger made changes -
        Description Some XLS documents hang the entire JVM. A control-C or regular kill won't stop the JVM, a kill -9 is required.

        We're running within an email server application parsing documents to extract text of all attachments. When we hit a message with the affected attachment the entire JVM hangs and we mark the message to skip extracting the text from the affected message the next attempt. Unfortunately, it kills all email processing on the server until the internal watchdogs kill -9 the application.

        We have seen the issue for several months with different documents, but they are always Excel files. Some get complaints from Excel when opening but not all.

        In addition to experiencing the problem on our Linux servers I have tested on OSX and experienced the same problems. I ran the Tika UI and select the affected file or run the CLI. The problem is the same.
        Tested with java -jar /path/to/tika-app-1.3.jar -t /path/to/file.xls

        When running on multi-CPU machines there are two threads running at 100% every time.

        Unfortunately, so far I am unable to post any affected documents publicly due to privacy concerns, however, I can provide samples privately for testing.

        I have tested with 1.2 and 1.3 with the same result. Running 1.1 the text is accurately extracted.
        Some XLS documents hang the entire JVM. A control-C or regular kill won't stop the JVM, a kill -9 is required.

        We're running within an email server application parsing documents to extract text of all attachments. When we hit a message with the affected attachment the entire JVM hangs and we mark the message to skip extracting the text from the affected message the next attempt. Unfortunately, it kills all email processing on the server until the internal watchdogs kill -9 the application.

        We have seen the issue for several months with different documents, but they are always Excel files. Some get complaints from Excel when opening but not all.

        In addition to experiencing the problem on our Linux servers I have tested on OSX and experienced the same problems. I ran the Tika UI and select the affected file or run the CLI. The problem is the same.
        Tested with java -jar /path/to/tika-app-1.3.jar -t /path/to/file.xls

        When running on multi-CPU machines there are two threads running at 100% every time.

        I have attached a document that triggers the error.

        I have tested with 1.2 and 1.3 with the same result. Running 1.1 the text is accurately extracted.
        Ryan Krueger made changes -
        Field Original Value New Value
        Attachment mod.xls [ 12587152 ]
        Ryan Krueger created issue -

          People

          • Assignee:
            Tim Allison
            Reporter:
            Ryan Krueger
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development