Bigtop
  1. Bigtop
  2. BIGTOP-273

Need to update puppet recipies for Hadoop 0.23 deployment

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None
    1. BIGTOP-273.patch.txt
      23 kB
      Roman Shaposhnik

      Activity

      Hide
      Roman Shaposhnik added a comment -

      This is still very much a work in progress. Couple of issues to note:
      1. mapred-app might be a name that'll need changing. Basically, this define encapsulates everything that needs to be installed on every node that is to participate in mapreduce application execution (yes, even though YARN separates the app from the framework, you still need to create local subdirectories, etc.)
      2. it is not clear whether different aspects of Application Manager (Resource Tracker, Scheduler, Resource Manager itself) can be deployed on different hosts or not. For now I clumped them together into a single resourcemanager definition with different ports for different services.

      Show
      Roman Shaposhnik added a comment - This is still very much a work in progress. Couple of issues to note: 1. mapred-app might be a name that'll need changing. Basically, this define encapsulates everything that needs to be installed on every node that is to participate in mapreduce application execution (yes, even though YARN separates the app from the framework, you still need to create local subdirectories, etc.) 2. it is not clear whether different aspects of Application Manager (Resource Tracker, Scheduler, Resource Manager itself) can be deployed on different hosts or not. For now I clumped them together into a single resourcemanager definition with different ports for different services.
      Hide
      Bruno Mahé added a comment -

      +1

      Show
      Bruno Mahé added a comment - +1

        People

        • Assignee:
          Roman Shaposhnik
          Reporter:
          Roman Shaposhnik
        • Votes:
          0 Vote for this issue
          Watchers:
          0 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development