Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-3314

Treat soft hyphens like hyphens

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.25
    • 1.26, 2.0.0-BETA
    • tika-eval
    • None

    Description

      The next PDFBox version identifies soft-hyphens (00AD) and returns them as such. Tika-eval swallows them, thus reporting differences. This can be shown with the file attached to PDFBOX-5115 in "Max-Planck-Institut" and in the attached excel file in line 4.

      Proposed change:
      add

      "\u00AD" => "-"

      to
      lucene-char-mapping.txt

      Attachments

        Issue Links

        relates to

        Bug - A problem which impairs or prevents the functions of the product. PDFBOX-5115 U+00AD ('sfthyphen') is not available in this font Times-Roman encoding: WinAnsiEncoding

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            tilman Tilman Hausherr
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment