[NIFI-9814] Add range sampling to SampleRecord

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: Extensions
• Assignee: Matt Burgess
• Reporter: Matt Burgess
• Created: 17/Mar/22 19:39
• Updated: 20/Jun/22 16:23

Description

It would be nice to be able to specify exactly which records or ranges of records are sampled from a FlowFile. For example if the first 5 lines of a comma-delimited file are free-text (meaning it's not technically a CSV file from NiFi's perspective as the first 5 lines do not constitute a header in this example), it would be handy to be able to exclude them by specifying a range filter of "6-" to say the 6th and every following record should be output.

In that vein SampleRecord could have a "range sampling" strategy where the user could specify something like "2, 5-7, 25-" where the second, fifth, sixth, seventh, and every record from the twenty-fifth record on would be included in the outgoing flow file.

Issue Links

• links to: GitHub Pull Request #5878