Mesos
  1. Mesos
  2. MESOS-177

Hadoop patch should pass HADOOP_CONF_DIR to executors

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Not a Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently, the Hadoop patch finds the executor binary at `pwd`/bin/mesos-executor and passes address of the jobtracker as an argument to it. It should also patch the Hadoop configuration directory location (e.g. as set through HADOOP_CONF_DIR or the --config option to bin/hadoop). This would allow one to run differently configured Hadoop jobtracker instances of the same version without creating a "shadow" bin directory (with a custom mesos-executor) or making a separate copy of the Hadoop directory for each instance.

        Activity

        Hide
        Benjamin Mahler added a comment -

        Hey Charles Reiss, is this still a problem? The hadoop framework has since been re-written and is no longer located inside the Mesos source. It's now found here: github.com/mesos/hadoop

        Should we file a similar issue there?

        Show
        Benjamin Mahler added a comment - Hey Charles Reiss , is this still a problem? The hadoop framework has since been re-written and is no longer located inside the Mesos source. It's now found here: github.com/mesos/hadoop Should we file a similar issue there?

          People

          • Assignee:
            Unassigned
            Reporter:
            Charles Reiss
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development