[GOBBLIN-1952] GaaS JobNames with long lengths cause issues with HDFS folders

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: gobblin-service
• Assignee: Abhishek Tiwari
• Reporter: William Lo
• Created: 07/Nov/23 00:06
• Updated: 08/Nov/23 18:06

Description

Gobblin-as-a-Service creates jobnames using flowgroups flownames, edges, and jobnames from the template. However, this tends to create a very long string which then causes issues in Gobblin job when creating files that use the jobname to create working directories or state stores. Although there has been previous code that shortens job name lengths, we want to further increase this by being more aggressive with the maximum length of the jobname to reduce the odds of exceeding 255 chars (max length of HDFS component)