[NIFI-7086] oracle db read is slow (for me its bug)

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Not A Problem
• Environment: nifi 1.8.0
• Assignee: Unassigned
• Reporter: naveen kumar saharan
• Created: 30/Jan/20 17:53
• Updated: 20/Dec/23 20:11
• Resolved: 20/Dec/23 20:11

Description

I am not able to fetch oracle db for 1 billion record table. It is taking too much time(17 hours).

I tried creating queries based on dates using executesql -> generatetablefetch -> executesql to parallel execution

small tables also performs slow as compared to python database table fetch program around 20 times slower. This is very disapppointing.

querydatabasetable runs only on primary node with , if i increase thread it give duplicate data.

Then what is the use of concurrent thread?