Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-2849

TikaInputStream copies the input stream locally

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.20
    • Fix Version/s: 1.21
    • Component/s: None
    • Labels:
      None

      Description

      When doing "tika.detect(stream, name)" and the stream is a "TikaInputStream", execution gets to "TikaInputStream#getPath" which does a "Files.copy(in, path, REPLACE_EXISTING);" which is very, very bad. This input stream could be, as in our case, an input stream from a network file which is tens or hundreds of gigabytes large. Copying it locally is a huge waste of resources to say the least. Why does it do that and can I make it not do it? Or is this something that has to be fixed in Tika?

        Attachments

        Issue Links

        is related to

        Task - A task that needs to be done. TIKA-2853 Consider applying NaiveBayes or similar simple ML to streaming zip detector

        • Major - Major loss of function.
        • Open

          Activity
          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              tallison Tim Allison
              Reporter:
              boris-petrov Boris Petrov

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment