Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-9283

DelimitedBoostTokenFilter can fail testRandomChains

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 9.0, 8.6
    • None
    • None
    • New

    Description

      DelimitedBoostTokenFilter expects tokens of the form `token` or `token|number` and throws a NumberFormatException if the `number` part can't be parsed. This can cause test failures when we build random chains and throw random data through them.

      We can either exclude DelimiteBoostTokenFilter when building a random analyzer, or add a flag to ignore badly-formed tokens. I lean towards doing the former, as I don't really want to make leniency the default here.

      Attachments

        Activity

          People

            romseygeek Alan Woodward
            romseygeek Alan Woodward
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: