Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-1599

Switch from TagSoup to JSoup

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.7, 1.8
    • 3.0.0-BETA
    • parser
    • None

    Description

      There are several Tika issues related to how TagSoup cleans up HTML (TIKA-381, TIKA-985, maybe TIKA-715), but TagSoup doesn't seem to be under active development.

      On the other hand I know of several projects that are now using JSoup, which is an active project (albeit only one main contributor) under the MIT license.

      I haven't looked into how hard it would be to switch this dependency.

      Attachments

        1. consumentenbond.html
          134 kB
          Markus Jelsma
        2. tagsoup_vs_jsoup_reports.zip
          1.20 MB
          Tim Allison
        3. TIKA-1599-crazy-files.tar.gz
          115 kB
          Markus Jelsma

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. TIKA-2539 TagSoup HTML parser is project EOL

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. TIKA-2010 Unable to get <title> value when header is incorrect

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. TIKA-2928 Less than sign within tag boundaries considered as start of a new tag.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. TIKA-2562 tika server parse HTML removes DIVs around hyperlink & adds shape

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. TIKA-4109 Remove use of EOL component TagSoup 1.2.1 from tika-parsers-standard-package

          • Major - Major loss of function.
          • Resolved
          supercedes

          Bug - A problem which impairs or prevents the functions of the product. TIKA-1808 Head section closed too eager

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #1356

          Activity

            People

              kkrugler Kenneth William Krugler
              kkrugler Kenneth William Krugler
              Votes:
              2 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: