[GOBBLIN-1374] Generate a unique staging path in FS SpecProducer for writing job specs

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.16.0
• Fix Version/s: 0.17.0
• Component/s: gobblin-cluster
• Assignee: Hung Tran
• Reporter: Sudarshan Vasudevan
• Created: 27/Jan/21 02:01
• Updated: 14/Jun/23 04:13

Description

Current implementation writes the job specs to a fixed staging location before the specs get renamed to a final publish location. To avoid concurrent producers writing to the same file, we generate a unique staging location.