Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: spark, tests
    • Labels:
      None

      Description

      ./gradlew bigtop-tests:smoke-tests:spark:test -Psmoke.tests --info fails with the following error on spark 2.x:

          17/01/23 12:55:05 ERROR itest.JarContent: No /usr/lib/spark/lib exists. Check your installation.
      

      It seems that $SPARK_HOME/lib/spark-examples.*jar has been moved to $SPARK_HOME/examples/jars and class JavaSparkSQL has been renamed JavaSparkSQLExample.

        Issue Links

          Activity

          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user asfgit closed the pull request at:

          https://github.com/apache/bigtop/pull/177

          Show
          githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/bigtop/pull/177
          Hide
          sekikn Kengo Seki added a comment -

          I've already tested it so will commit shortly. Thanks!

          Show
          sekikn Kengo Seki added a comment - I've already tested it so will commit shortly. Thanks!
          Hide
          evans_ye Evans Ye added a comment -

          LGTM. +1 w/o testing.
          Please commit if you've it tested.

          Show
          evans_ye Evans Ye added a comment - LGTM. +1 w/o testing. Please commit if you've it tested.
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user sekikn opened a pull request:

          https://github.com/apache/bigtop/pull/177

          BIGTOP-2676: Smoke test fails on Spark 2

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/sekikn/bigtop BIGTOP-2676

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/bigtop/pull/177.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #177



          Show
          githubbot ASF GitHub Bot added a comment - GitHub user sekikn opened a pull request: https://github.com/apache/bigtop/pull/177 BIGTOP-2676 : Smoke test fails on Spark 2 You can merge this pull request into a Git repository by running: $ git pull https://github.com/sekikn/bigtop BIGTOP-2676 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/bigtop/pull/177.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #177

            People

            • Assignee:
              sekikn Kengo Seki
              Reporter:
              sekikn Kengo Seki
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development