Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-273

Need to update puppet recipies for Hadoop 0.23 deployment

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None
    1. BIGTOP-273.patch.txt
      23 kB
      Roman Shaposhnik

      Activity

      Hide
      rvs Roman Shaposhnik added a comment -

      This is still very much a work in progress. Couple of issues to note:
      1. mapred-app might be a name that'll need changing. Basically, this define encapsulates everything that needs to be installed on every node that is to participate in mapreduce application execution (yes, even though YARN separates the app from the framework, you still need to create local subdirectories, etc.)
      2. it is not clear whether different aspects of Application Manager (Resource Tracker, Scheduler, Resource Manager itself) can be deployed on different hosts or not. For now I clumped them together into a single resourcemanager definition with different ports for different services.

      Show
      rvs Roman Shaposhnik added a comment - This is still very much a work in progress. Couple of issues to note: 1. mapred-app might be a name that'll need changing. Basically, this define encapsulates everything that needs to be installed on every node that is to participate in mapreduce application execution (yes, even though YARN separates the app from the framework, you still need to create local subdirectories, etc.) 2. it is not clear whether different aspects of Application Manager (Resource Tracker, Scheduler, Resource Manager itself) can be deployed on different hosts or not. For now I clumped them together into a single resourcemanager definition with different ports for different services.
      Hide
      bmahe Bruno Mahé added a comment -

      +1

      Show
      bmahe Bruno Mahé added a comment - +1

        People

        • Assignee:
          rvs Roman Shaposhnik
          Reporter:
          rvs Roman Shaposhnik
        • Votes:
          0 Vote for this issue
          Watchers:
          0 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development