[NIFI-4227] Create a ForkRecord processor - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.7.0
Component/s: Extensions
Labels:
None

Description

I'd like a way to fork a record containing an array of records into multiple records, each one being an element of the array. In addition, if configured to, I'd like the option to add to each new record the parent fields.

For example, if I've:

[{
	"id": 1,
	"name": "John Doe",
	"address": "123 My Street",
	"city": "My City", 
	"state": "MS",
	"zipCode": "11111",
	"country": "USA",
	"accounts": [{
		"id": 42,
		"balance": 4750.89
	}, {
		"id": 43,
		"balance": 48212.38
	}]
}, 
{
	"id": 2,
	"name": "Jane Doe",
	"address": "345 My Street",
	"city": "Her City", 
	"state": "NY",
	"zipCode": "22222",
	"country": "USA",
	"accounts": [{
		"id": 45,
		"balance": 6578.45
	}, {
		"id": 46,
		"balance": 34567.21
	}]
}]

Then, I want to generate records looking like:

[{
	"id": 42,
	"balance": 4750.89
}, {
	"id": 43,
	"balance": 48212.38
}, {
	"id": 45,
	"balance": 6578.45
}, {
	"id": 46,
	"balance": 34567.21
}]

Or, if parent fields are included, looking like:

[{
	"name": "John Doe",
	"address": "123 My Street",
	"city": "My City", 
	"state": "MS",
	"zipCode": "11111",
	"country": "USA",
	"id": 42,
	"balance": 4750.89
}, {
	"name": "John Doe",
	"address": "123 My Street",
	"city": "My City", 
	"state": "MS",
	"zipCode": "11111",
	"country": "USA",
	"id": 43,
	"balance": 48212.38
}, {
	"name": "Jane Doe",
	"address": "345 My Street",
	"city": "Her City", 
	"state": "NY",
	"zipCode": "22222",
	"country": "USA",
	"id": 45,
	"balance": 6578.45
}, {
	"name": "Jane Doe",
	"address": "345 My Street",
	"city": "Her City", 
	"state": "NY",
	"zipCode": "22222",
	"country": "USA",
	"id": 46,
	"balance": 34567.21
}]