[APEXCORE-482] Default Unifiers should be ThreadLocal with downstream operators

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Sandesh Hegde
• Created: 08/Jul/16 15:33
• Updated: 17/Apr/17 22:06

Description

Default Unifiers are currently deployed ( except in Mx1 ) as CONTAINER_LOCAL with the downstream operator. It is better to make it THREAD_LOCAL to improve the performance.

Custom unifiers can still be CONTAINER_LOCAL and possibly allow the users to control the behaviours.

Note: Created a prototype to understand the root cause : https://github.com/sandeshh/apex-core/commit/550f31c770b704360c813924e85a9fffeaec7c53
During PhysicalPlan creation downstream operator's input port won't have stream locality assigned. So StreamingContainerAgent assigns CONTAINER_LOCAL

Actual implementation should be done in Physical Plan.

Issue Links

• links to: GitHub Pull Request #358