Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1310

Vagrant recipes provision 2.0 hadoop w/ puppet recipes that are compatible with 2.2

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      I'm noticing in the Vagrant recipe, that if i do

      vagrant up bigtop1
      

      I get an error :

      "Invalid shuffle port number -1"

      I then have to change the do

        <value>mapreduce.shuffle</value>   
      

      And it works !

      I looked further and saw that BIGTOP-1118 actually changed the value , for hadoop 2.2.

      So this means hadoop 2.0 is NOT compatible with bigtop puppet recipes, which are built for hadoop 2.2+ anymore.

      1) We need to gaurd puppet recipes: They should only be applied to the appropriate hadoop version. Is there a way to do this?

      2) We need to upgrade vagrant incantations to provison current bigtop if theres a way to do that, or at least hard code them to 2.2 , rather than 2.0.

        Attachments

          Activity

            People

            • Assignee:
              jayunit100 jay vyas
              Reporter:
              jayunit100 jay vyas
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: