[GOBBLIN-364] Exclude JobState from WorkUnit created by PartitionedFileSourceBase

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Assignee: Zhixiong Chen
• Reporter: Zhixiong Chen
• Created: 10/Jan/18 17:36
• Updated: 21/Mar/18 11:45
• Resolved: 10/Jan/18 19:56

Description

Currently, each `WorkUnit` created by a `PartitionedFileSourceBase` source has a copy of the entire job configurations. For the following 2 reasons, we want to exclude job configurations from `WorkUnit`:

• It's redundant as the runtime counterpart of `WorkUnit`, which is `WorkUnitState`, would have a reference to all job configurations.
• Adding job configurations to `WorkUnit` has the bad side effect of masking dynamic job level configurations in MR Task runner