Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-2673

HtmlEncodingDetector doesn't follow the specification

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.19, 2.0.0
    • None
    • None

    Description

      This bug is linked to TIKA-2671, but does not concern metadata, but rather the bytes-based detection itself.

      While reading the specification, I collected a list of sample cases where HtmlEncodingDetector differs from the specification, and thus fails at detecting the right charset.

      I am attaching the test cases to this issue:

      Attachments

        1. HtmlEncodingDetectorTest.java
          4 kB
          Gerard Bouchar
        2. image-2018-07-13-11-28-16-657.png
          9 kB
          Gerard Bouchar
        3. StrictHtmlEncodingDetector.tar.gz
          8 kB
          Gerard Bouchar

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. TIKA-2933 Revisit "replacement" encoding mappings in StandardHtmlEncodingDetector.

          • Major - Major loss of function.
          • Open

          Activity

            People

              tallison Tim Allison
              gbouchar Gerard Bouchar
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: