Hadoop Common
  1. Hadoop Common
  2. HADOOP-7056

NN unintentionally reads mapred-site.xml

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Critical Critical
    • Resolution: Unresolved
    • Affects Version/s: 0.22.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      It seems that mapred-site.xml is now unintentionally being read by the NN, and probably all the daemons.

      This is because the Groups constructor calls ReflectionUtils.newInstance(...), which in turn calls ReflectionUtils.setConf(...), which calls ReflectionUtils.setJobConf(...), which creates an instance of o.a.h.mapred.JobConf, which calls o.a.h.mapreduce.util.ConfigUtil.loadResources(...), which reads in mapred-site.xml and mapred-default.xml. Phew!

      I suspect the appropriate solution is for ReflectionUtils.setConf(...) to be changed to not call (the mapred-specific) ReflectionUtils.setJobConf(...), but there's a comment in there which says it's being left in place for backward compatibility. Can somebody with more knowledge of that situation please comment?

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            Aaron T. Myers
          • Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

            • Created:
              Updated:

              Development