[TEZ-668] Allow a Processor to trigger an Input as to when to fetch/prep data.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.3.0
• Assignee: Siddharth Seth
• Reporter: Hitesh Shah
• Created: 10/Dec/13 19:50
• Updated: 01/Mar/14 04:19
• Resolved: 18/Feb/14 03:11

Description

In cases of container re-use or other scenarios, a processor may not need to process any data from a particular Input. Currently, an Input always fetches/preps the data as soon as its init() function is invoked.

A Processor should have a way to trigger the Input to fetch data. This obviously has some overheads of delaying the fetch.

The approach should be such that there is no additional burden on developers who write new processors when they need the normal flow of their inputs always fetching on init().

Issue Links

• is blocked by: TEZ-827 Separate initialize and start operations on Inputs/Outputs
• is related to: TEZ-711 Fix memory leak when not reading from inputs due to caching
• is related to: TEZ-667 BroadcastShuffleManager should not report errors after it has been closed
• is required by: TEZ-388 Pig on Tez