Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.2-alpha, 0.23.3
    • Component/s: None
    • Labels:
      None

      Description

      Move YARN out of hadoop-mapreduce-project into hadoop-yarn-project in hadoop trunk

      1. YARN-1.sh
        0.5 kB
        Arun C Murthy
      2. YARN-1.patch
        23 kB
        Arun C Murthy
      3. YARN-1.patch
        25 kB
        Arun C Murthy

        Activity

        Hide
        Arun C Murthy added a comment -

        Here is a script & patch.

        YARN-1.sh just does an 'svn move' while YARN-1.patch is the necessary build changes.

        I'd appreciate a review.

        Show
        Arun C Murthy added a comment - Here is a script & patch. YARN-1 .sh just does an 'svn move' while YARN-1 .patch is the necessary build changes. I'd appreciate a review.
        Hide
        Alejandro Abdelnur added a comment -

        I've done a build with -Pdist and I was able to run one of the MR examples after tweaking the the hadoop-config.sh in libexec/ to

        YARN_DIR=${YARN_DIR:-"share/hadoop/yarn"}
        YARN_LIB_JARS_DIR=${YARN_LIB_JARS_DIR:-"share/hadoop/yarn/lib"}
        

        The patch is missing this change in the hadoop-config.sh file

        Other than that seems OK.

        I think we should follow with 2 JIRAs to flatten all submodules under hadoop-mapreduce-project and hadoop-yarn-project modules. Also, to remove <dependencies> sections from the aggregator POMs.

        Show
        Alejandro Abdelnur added a comment - I've done a build with -Pdist and I was able to run one of the MR examples after tweaking the the hadoop-config.sh in libexec/ to YARN_DIR=${YARN_DIR:- "share/hadoop/yarn" } YARN_LIB_JARS_DIR=${YARN_LIB_JARS_DIR:- "share/hadoop/yarn/lib" } The patch is missing this change in the hadoop-config.sh file Other than that seems OK. I think we should follow with 2 JIRAs to flatten all submodules under hadoop-mapreduce-project and hadoop-yarn-project modules. Also, to remove <dependencies> sections from the aggregator POMs.
        Hide
        Arun C Murthy added a comment -

        Thanks for the review Alejandro, I've incorporated your feedback. I think this looks good to go...

        Show
        Arun C Murthy added a comment - Thanks for the review Alejandro, I've incorporated your feedback. I think this looks good to go...
        Hide
        Alejandro Abdelnur added a comment -

        +1

        Show
        Alejandro Abdelnur added a comment - +1
        Hide
        Arun C Murthy added a comment -

        Thanks for the review Alejandro. I've just committed this.

        Please open a jira for your views on flattening heirarchy etc., they seem very reasonable.

        Show
        Arun C Murthy added a comment - Thanks for the review Alejandro. I've just committed this. Please open a jira for your views on flattening heirarchy etc., they seem very reasonable.
        Hide
        Robert Joseph Evans added a comment -

        Arun can you add in 0.23.3 as a version for yarn? I merged this into 0.23.3, but I have no way to mark it in the JIRA.

        Show
        Robert Joseph Evans added a comment - Arun can you add in 0.23.3 as a version for yarn? I merged this into 0.23.3, but I have no way to mark it in the JIRA.
        Hide
        Eli Collins added a comment -

        The branch-2.1.0-alpha commit had the mvn vresion set to 3.0.0-SNAPSHOT, I updated it to 2.1.0-SNAPSHOT. There are still build issues in this branch, filed YARN-36.

        Show
        Eli Collins added a comment - The branch-2.1.0-alpha commit had the mvn vresion set to 3.0.0-SNAPSHOT, I updated it to 2.1.0-SNAPSHOT. There are still build issues in this branch, filed YARN-36 .

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Arun C Murthy
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development