Details
-
Improvement
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
At the moment, when using the GrokReader, if a line does not match the grok expression (and is not part of a stack trace), the line can be either ignored (the line will be completely skipped) or appended to the last field from the previous line.
In the case where appending is not desired and that data should not be ignored/deleted, we should add the option to route the full flow file to the failure relationship. This way the flow file could be treated in a different way (for example with SplitText and ExtractGrok to isolate the incorrect lines and re-route the correct lines back to the Record processors).
