Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1522

nodemanager deployment needs to include hadoop-mapreduce package

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 1.0.0
    • Component/s: deployment
    • Labels:
      None

      Description

      It appears that if a cluster is deployed with only

      components,hadoop,yarn
      

      set in bigtop-deploy/puppet/config/site.csv the nodemanager refuses to start as it can not find org.apache.hadoop.mapred.ShuffleHandler

      Clearly, the mapreduce component needs to be installed in order for the nodemanager to function properly.

      YARN is totally "not a MapReduce". Yeah, right!

      1. BIGTOP-1522.patch
        0.6 kB
        Konstantin Boudnik

        Issue Links

          Activity

          Hide
          cos Konstantin Boudnik added a comment -

          thanks dude - and sorry: wasn't intentional.

          Show
          cos Konstantin Boudnik added a comment - thanks dude - and sorry: wasn't intentional.
          Hide
          jayunit100 jay vyas added a comment - - edited

          no prob ! BIGTOP-1365 <-- I will added it to the work in this one and tackle it now

          UPDATE : Sorry this guy is closed. ill find a place to put this update. i think we have a puppet comments jira somewjhere

          Show
          jayunit100 jay vyas added a comment - - edited no prob ! BIGTOP-1365 <-- I will added it to the work in this one and tackle it now UPDATE : Sorry this guy is closed. ill find a place to put this update. i think we have a puppet comments jira somewjhere
          Hide
          cos Konstantin Boudnik added a comment -

          Sorry dude - I have missed you hint about the comment. Is it critical so I should open a new ticket and fix it there?

          Show
          cos Konstantin Boudnik added a comment - Sorry dude - I have missed you hint about the comment. Is it critical so I should open a new ticket and fix it there?
          Hide
          cos Konstantin Boudnik added a comment -

          Committed and pushed as
          204f01b..e1a6461 HEAD -> master

          Show
          cos Konstantin Boudnik added a comment - Committed and pushed as 204f01b..e1a6461 HEAD -> master
          Hide
          jayunit100 jay vyas added a comment - - edited

          actually, can i ask that you add a comment to your patch ? so its clear why we're adding that mapred dependency ?

          i can see this regressing when someone goes to clean up the puppet code otherwise !

          (preapproved +1 pending addition of comment to the patch)

          Show
          jayunit100 jay vyas added a comment - - edited actually, can i ask that you add a comment to your patch ? so its clear why we're adding that mapred dependency ? i can see this regressing when someone goes to clean up the puppet code otherwise ! (preapproved +1 pending addition of comment to the patch)
          Hide
          jayunit100 jay vyas added a comment - - edited

          hahaha wow thats interesting. +1 makes sense, although i havent tested. patch applied successfully w -p1

          Show
          jayunit100 jay vyas added a comment - - edited hahaha wow thats interesting. +1 makes sense, although i havent tested. patch applied successfully w -p1
          Hide
          cos Konstantin Boudnik added a comment -

          Simple fix.

          Show
          cos Konstantin Boudnik added a comment - Simple fix.

            People

            • Assignee:
              cos Konstantin Boudnik
              Reporter:
              cos Konstantin Boudnik
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development