[HADOOP-15357] Configuration.getPropsWithPrefix no longer does variable substitution

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.9.0, 3.0.0
• Fix Version/s: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3
• Target Version/s: 3.2.0, 3.1.1, 2.9.2, 3.0.3
• Hadoop Flags: Reviewed
• Assignee: Jim Brennan
• Reporter: Jim Brennan
• Created: 02/Apr/18 18:06
• Updated: 10/Apr/18 22:22
• Resolved: 10/Apr/18 22:01

Description

Before HADOOP-13556, Configuration.getPropsWithPrefix() used the Configuration.get() method to get the value of the variables. After HADOOP-13556, it now uses props.getProperty().

The difference is that Configuration.get() does deprecation handling and more importantly variable substitution on the value. So if a property has a variable specified with ${variable_name}, it will no longer be expanded when retrieved via getPropsWithPrefix().

Was this change in behavior intentional? I am using this function in the fix for MAPREDUCE-7069, but we do want variable expansion to happen.

Issue Links

• is caused by: HADOOP-13556 Change Configuration.getPropsWithPrefix to use getProps instead of iterator