[PIG-5052] Initialize MRConfiguration.JOB_ID in spark mode correctly

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: spark-branch
• Component/s: spark
• Assignee: Ádám Szita
• Reporter: liyunzhang
• Created: 28/Oct/16 04:49
• Updated: 21/Jun/17 09:18
• Resolved: 22/Nov/16 09:31

Description

currently, we initialize MRConfiguration.JOB_ID in SparkUtil#newJobConf.
we just set the value as a random string.

        jobConf.set(MRConfiguration.JOB_ID, UUID.randomUUID().toString());

We need to find a spark api to initiliaze it correctly.