Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3690

JFlex-based HTMLStripCharFilter replacement

          Details

          • Type: New Feature
          • Status: Closed
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 3.5, 4.0-ALPHA
          • Fix Version/s: 3.6, 4.0-ALPHA
          • Component/s: modules/analysis
          • Labels:
            None
          • Lucene Fields:
            New, Patch Available

            Description

            A JFlex-based HTMLStripCharFilter replacement would be more performant and easier to understand and maintain.

              Attachments

              1. LUCENE-3690-handle-utf16-surrogates.patch
                13 kB
                Steve Rowe
              2. LUCENE-3690.patch
                229 kB
                Steve Rowe
              3. LUCENE-3690.patch
                230 kB
                Steve Rowe
              4. LUCENE-3690.patch
                924 kB
                Steve Rowe
              5. LUCENE-3690.patch
                2.36 MB
                Steve Rowe
              6. LUCENE-3690.patch
                2.41 MB
                Steve Rowe
              7. JFlexHTMLStripCharFilterWarcTest.java
                4 kB
                Steve Rowe
              8. jenkins_test.patch
                1 kB
                Robert Muir
              9. HTMLStripCharFilterWarcTest.java
                4 kB
                Steve Rowe
              10. BaselineWarcTest.java
                3 kB
                Steve Rowe

                Issue Links

                requires

                Improvement - An improvement or enhancement to an existing feature or task. SOLR-882 HTMLStripReader improvement - padding corrected for hexadecimal entities, option not to emit padding at all added

                • Trivial - Cosmetic problem like misspelt words or misaligned text.
                • Closed
                supercedes

                Bug - A problem which impairs or prevents the functions of the product. LUCENE-2208 Token div exceeds length of provided text sized 4114

                • Major - Major loss of function.
                • Closed

                Bug - A problem which impairs or prevents the functions of the product. SOLR-42 Highlighting problems with HTMLStripWhitespaceTokenizerFactory

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Closed

                  Activity

                    People

                    • Assignee:
                      steve_rowe Steve Rowe
                      Reporter:
                      steve_rowe Steve Rowe
                    • Votes:
                      3 Vote for this issue
                      Watchers:
                      2 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: