Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-3314

Treat soft hyphens like hyphens

Agile BoardAttach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 1.25
    • 1.26, 2.0.0-BETA
    • tika-eval
    • None

    Description

      The next PDFBox version identifies soft-hyphens (00AD) and returns them as such. Tika-eval swallows them, thus reporting differences. This can be shown with the file attached to PDFBOX-5115 in "Max-Planck-Institut" and in the attached excel file in line 4.

      Proposed change:
      add

      "\u00AD" => "-"

      to
      lucene-char-mapping.txt

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            tilman Tilman Hausherr

            Dates

              Created:
              Updated:

              Slack

                Issue deployment