[FLINK-4628] User class loader unavailable during input split assignment

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.1.2, 1.2.0
• Fix Version/s: 1.2.0
• Component/s: Runtime / Coordination
• Assignee: Maximilian Michels
• Reporter: Maximilian Michels
• Created: 16/Sep/16 10:15
• Updated: 28/Feb/19 14:02
• Resolved: 22/Sep/16 13:54

Description

InputFormat\s runs through two configuration phases in the JobManager.

1. initializeOnMaster which runs the configure() method on the InputFormat
2. createInputSplits when the ExecutionJobVertex is created

In 1 we set the user class loader as the context class loader of the executing thread.

In 2 we only have the system class loader available. If any classes need to be loaded then, we have a problem. Some InputFormats rely on code which lazily load classes at different points in time.

In particular, this is a problem with the HBase TableInputFormat in the latest master.

We should make the user class loader available when creating input splits.

Issue Links

• links to: GitHub Pull Request #2505