[OOZIE-2338] Invalid configuration defined reported for some valid configs

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.2.0
• Component/s: core
• Assignee: Unassigned
• Reporter: Robert Kanter
• Created: 20/Aug/15 01:25
• Updated: 23/Nov/21 01:31

Description

OOZIE-1890 moved all default config values from the code and oozie-site into oozie-default; it also added a WARN message on startup when a config is found in oozie-site that's not defined in oozie-default.

However, this can produce some false positives. In particular, we observed these:

2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.auth]
2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.host]
2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.HCatAccessorService.hcat.configuration]
2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.from.address]
2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.ProxyUserService.proxyuser.hue.hosts]
2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.GroupsService.hadoop.security.group.mapping]
2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.port]
2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.ProxyUserService.proxyuser.hue.groups]

While harmful, these messages may be concerning or confusing for users.

Some of these are simply missing from oozie-default (because they have no default value?), while others such as the ProxyUserService configs, will require special handling because the property name can vary.

Issue Links

• is a clone of: OOZIE-3432 When use configuration oozie.service.ProxyUserService.root.hosts, oozie-error.log shows Invalid configuration defined
• is cloned by: OOZIE-3432 When use configuration oozie.service.ProxyUserService.root.hosts, oozie-error.log shows Invalid configuration defined
• is related to: OOZIE-1890 Make oozie-site empty and reconcile defaults between oozie-default and the code
• is related to: OOZIE-3462 Reconcile defaults between oozie-default.xml and the code