[REEF-663] Make Http URI available for REEF client

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13
• Assignee: Julia Wang
• Reporter: Julia Wang
• Created: 28/Aug/15 02:53
• Updated: 07/Oct/15 16:59
• Resolved: 19/Sep/15 04:22

Description

In REEF driver, http server port number is generated on the fly. Even client can specify it, in case conflict happens, REEF will get an available one at run time. In order for client to get it after the driver is started, it should be returned to the client after client submits a request.

An approach we are going to take is to write the http end point to a HDFS once the uri is available. YarnJobSubmissionClient will read from it and write it to JobDriver folder

ReefClient will read it from the file and return it to the Job Submitter.

Issue Links

• is related to: REEF-189 Provide a C# Client to REEF
• is related to: REEF-70 Facilitate submission from clients with no Java installed
• relates to: REEF-712 Add a test for Evaluator-Preserving Driver restarts
• relates to: REEF-813 IREEFClient.Submit should return better error/progress messages