[GOBBLIN-1462] Ensure FsSpecConsumer handles config keys which are prefixes of other keys

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.15.0
• Fix Version/s: 0.17.0
• Component/s: gobblin-cluster
• Assignee: Sudarshan Vasudevan
• Reporter: Sudarshan Vasudevan
• Created: 09/Jun/21 00:32
• Updated: 14/Jun/23 04:13

Description

Currently, the FsSpecConsumer fails when building a JobSpec if the configuration contains keys which are prefixes of other keys, which is not allowed in typesafe config. In practice, this constraint may be violated particularly when loading system properties which are outside application's control. To ensure these properties are safely handled, the FsSpecConsumer should use the proertiesToConfig() method in PropertiesUtils which adds a suffix to the root properties.