[REEF-1066] Clarify differences between REEF job identifiers.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Build infrastructure, Documentation, REEF-Common
• Assignee: Unassigned
• Reporter: Sergey Dudoladov
• Created: 11/Dec/15 11:20
• Updated: 14/Dec/15 09:22

Description

REEF references a single job using the named parameters LaunchID, JobIdentifier, ApplicationIdentifier and possibly others. The EvaluatorConfiguration.java (lines 60-61) binds LaunchID and ApplicationIdentifier to the same optional parameter APPLICATION_IDENTIFIER, which AllocatedEvaluatorImpl.java (line 301) resets to whatever value its jobIdentifier field contains.

This issue should
1) Add tests to ensure that the intended naming behavior is not lost by accident.
2) Modify the comments and doc strings of the parameters above to describe when to use which parameter.
3) Add reasonable default values to the parameters.
4) Document the use of identifiers in the REEF wiki.

For more details, look at the initial pull request for REEF-818

Issue Links

• blocks: REEF-818 EvaluatorManager should get job id from evaluator configuration
• is related to: REEF-1071 Fix Driver Restart to correctly use the YARN application ID and not use the Job ID passed in by the user