[CAMEL-21269] camel-langchain4j-tokenizer: tokenizer are unusable in YAML

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.8.0
• Fix Version/s: 4.8.1, 4.9.0
• Component/s: camel-langchain4j-tokenizer
• Estimated Complexity: Unknown
• Assignee: Otavio Rodolfo Piske
• Reporter: Otavio Rodolfo Piske
• Created: 25/Sep/24 19:32
• Updated: 01/Oct/24 12:26
• Resolved: 01/Oct/24 12:25

Description

byCharacter, byLine, byWord, bySentence, byParagraph are not part of the Camel catalog for langchain4j tokenizer
https://github.com/apache/camel/blob/bd427fb7b288011aafafce88076e7792168f8da7/catalog/camel-catalog/src/generated/resources/org/apache/camel/catalog/models/langChain4j.json#L15

There is an incomplete definition of the tokenizer DSL that prevents it from being used in YAML.

Issue Links

• is a clone of: CAMEL-21245 Specific langchain4j tokenizer are missing in Catalog
• links to: GitHub Pull Request #15705
• links to: GitHub Pull Request #15729