Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7056

NN unintentionally reads mapred-site.xml

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 0.22.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      It seems that mapred-site.xml is now unintentionally being read by the NN, and probably all the daemons.

      This is because the Groups constructor calls ReflectionUtils.newInstance(...), which in turn calls ReflectionUtils.setConf(...), which calls ReflectionUtils.setJobConf(...), which creates an instance of o.a.h.mapred.JobConf, which calls o.a.h.mapreduce.util.ConfigUtil.loadResources(...), which reads in mapred-site.xml and mapred-default.xml. Phew!

      I suspect the appropriate solution is for ReflectionUtils.setConf(...) to be changed to not call (the mapred-specific) ReflectionUtils.setJobConf(...), but there's a comment in there which says it's being left in place for backward compatibility. Can somebody with more knowledge of that situation please comment?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              atm Aaron T. Myers
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated: