Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1726

Confirm that Spark 1.2.1 runs properly in BigTop, and run the BPS integration test.

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.0.0
    • Component/s: None
    • Labels:
      None

      Description

      According to a mailing list thread in spark, some folks have been failing at compiling spark 1.2.1 manually, and are curious wether bigtop compiles it properly or not.

      Lets do a second round of testing to confirm that spark 1.2.1 is in tip top shape.

        Activity

        Hide
        jayunit100 jay vyas added a comment -

        yup resolved.

        Show
        jayunit100 jay vyas added a comment - yup resolved.
        Hide
        warwithin YoungWoo Kim added a comment -

        jay vyas,
        I believe that revealed issues on Spark 1.2.1 in Bigtop are resolved. Let's focus on Spark 1.3.0.

        Show
        warwithin YoungWoo Kim added a comment - jay vyas , I believe that revealed issues on Spark 1.2.1 in Bigtop are resolved. Let's focus on Spark 1.3.0.
        Hide
        jayunit100 jay vyas added a comment -

        This is working, just tested it.

                          │  (use "git add <file>..." to include in what will be committed)
             / __/__  ___ _____/ /__                                                         │
            _\ \/ _ \/ _ `/ __/  '_/                                                         │        bigtop-bigpetstore/bigpetstore-mapreduce/petstoredata/
           /___/ .__/\_,_/_/ /_/\_\   version 1.2.1                                          │        bigtop-deploy/vm/dev/
              /_/                                                                            │        bigtop-deploy/vm/docker-puppet/
                                                                                             │        bigtop-deploy/vm/vagrant-puppet/
        Using Scala version 2.10.4 (OpenJDK 64-Bit Server VM, Java 1.7.0_75)                 │        etc/
        Type in expressions to have them evaluated.                                          │        usr/
        Type :help for more information.                                                     │
        15/03/07 23:19:04 INFO SecurityManager: Changing view acls to: vagrant  
        
        
        Show
        jayunit100 jay vyas added a comment - This is working, just tested it. │ (use "git add <file>..." to include in what will be committed) / __/__ ___ _____/ /__ │ _\ \/ _ \/ _ `/ __/ '_/ │ bigtop-bigpetstore/bigpetstore-mapreduce/petstoredata/ /___/ .__/\_,_/_/ /_/\_\ version 1.2.1 │ bigtop-deploy/vm/dev/ /_/ │ bigtop-deploy/vm/docker-puppet/ │ bigtop-deploy/vm/vagrant-puppet/ Using Scala version 2.10.4 (OpenJDK 64-Bit Server VM, Java 1.7.0_75) │ etc/ Type in expressions to have them evaluated. │ usr/ Type :help for more information. │ 15/03/07 23:19:04 INFO SecurityManager: Changing view acls to: vagrant
        Hide
        jayunit100 jay vyas added a comment -

        hi Jonathan Kelly

        We can test this easily and confirm/deny its working

        (0) gradle spark-yum (creates output/ with the rpm.
        (1) vagrantconf.yaml to include output/ build directory,
        (2) add spark to components, and
        (3) vagrant up .

        Show
        jayunit100 jay vyas added a comment - hi Jonathan Kelly We can test this easily and confirm/deny its working (0) gradle spark-yum (creates output/ with the rpm. (1) vagrantconf.yaml to include output/ build directory, (2) add spark to components, and (3) vagrant up .

          People

          • Assignee:
            Unassigned
            Reporter:
            jayunit100 jay vyas
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development