Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2338

Invalid configuration defined reported for some valid configs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 4.2.0
    • Fix Version/s: None
    • Component/s: core
    • Labels:
      None

      Description

      OOZIE-1890 moved all default config values from the code and oozie-site into oozie-default; it also added a WARN message on startup when a config is found in oozie-site that's not defined in oozie-default.

      However, this can produce some false positives. In particular, we observed these:

      2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.auth]
      2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.host]
      2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.HCatAccessorService.hcat.configuration]
      2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.from.address]
      2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.ProxyUserService.proxyuser.hue.hosts]
      2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.GroupsService.hadoop.security.group.mapping]
      2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.port]
      2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.ProxyUserService.proxyuser.hue.groups]
      

      While harmful, these messages may be concerning or confusing for users.

      Some of these are simply missing from oozie-default (because they have no default value?), while others such as the ProxyUserService configs, will require special handling because the property name can vary.

        Attachments

        1. oozie-2338-005.patch
          2 kB
          duan xiong
        2. oozie-2338-004.patch
          2 kB
          duan xiong
        3. oozie-2338-003.patch
          2 kB
          duan xiong
        4. OOZIE-2338.002.patch
          14 kB
          Robert Kanter
        5. OOZIE-2338.001.patch
          15 kB
          Robert Kanter

          Issue Links

            Activity

              People

              • Assignee:
                nobigo duan xiong
                Reporter:
                rkanter Robert Kanter
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: