Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2338

Invalid configuration defined reported for some valid configs

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 4.2.0
    • None
    • core
    • None

    Description

      OOZIE-1890 moved all default config values from the code and oozie-site into oozie-default; it also added a WARN message on startup when a config is found in oozie-site that's not defined in oozie-default.

      However, this can produce some false positives. In particular, we observed these:

      2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.auth]
      2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.host]
      2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.HCatAccessorService.hcat.configuration]
      2015-08-18 01:16:32,365 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.from.address]
      2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.ProxyUserService.proxyuser.hue.hosts]
      2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.GroupsService.hadoop.security.group.mapping]
      2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.email.smtp.port]
      2015-08-18 01:16:32,366 WARN org.apache.oozie.service.ConfigurationService: SERVER[<redacted>] Invalid configuration defined, [oozie.service.ProxyUserService.proxyuser.hue.groups]
      

      While harmful, these messages may be concerning or confusing for users.

      Some of these are simply missing from oozie-default (because they have no default value?), while others such as the ProxyUserService configs, will require special handling because the property name can vary.

      Attachments

        1. OOZIE-2338.001.patch
          15 kB
          Robert Kanter
        2. OOZIE-2338.002.patch
          14 kB
          Robert Kanter
        3. oozie-2338-003.patch
          2 kB
          xiong duan
        4. oozie-2338-004.patch
          2 kB
          xiong duan
        5. oozie-2338-005.patch
          2 kB
          xiong duan

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            rkanter Robert Kanter

            Dates

              Created:
              Updated:

              Slack

                Issue deployment