Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1258

Add Spark packages support to Livy interpreter

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.7.0
    • Component/s: None
    • Labels:
      None

      Description

      Allowing to livy interpeter to include more libraries.

        Issue Links

          Activity

          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user mfelgamal opened a pull request:

          https://github.com/apache/zeppelin/pull/1255

          Adding extra libraries to livy

              1. What is this PR for?
                Adding extra libraries to livy interpreter which isn't exist by default.
              1. What type of PR is it?
                [ Improvement ]
              1. Todos
          • [Test case ] - Task
              1. What is the Jira issue?
              1. How should this be tested?
          • Create new livy interpreter or modify the default.
          • Set `livy.spark.driver.extraClassPath` and `livy.spark.executor.extraClassPath` to path of libraries.
              1. Screenshots (if appropriate)
                ![](https://s32.postimg.org/cxo94lzc5/livy_example_with_external_library.png)
                ![](https://s31.postimg.org/41gbe8hwr/add_Classpath_property_to_livy.png)
              1. Questions:
          • Does the licenses files need update? no
          • Is there breaking changes for older versions? no
          • Does this needs documentation? yes

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/novelari/incubator-zeppelin feature/modifying-livy-doc

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/zeppelin/pull/1255.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #1255


          commit 2586651ab9768e484e04a840978d6db8d5659f48
          Author: Fouad <fuad.assayadi@gmail.com>
          Date: 2016-05-29T14:39:08Z

          Merge pull request #2 from apache/master

          update from original

          commit 03a1e80f8f3115a75c42fa25fdaa06e7dd2cbc28
          Author: mfelgamal <mahmoudf.elgamal@gmail.com>
          Date: 2016-07-19T18:28:46Z

          Merge pull request #4 from apache/master

          merge master

          commit 98090abc075b97e3896ae6ea0c6e48f57e8d6434
          Author: mahmoudelgamal <mahmoudf.elgamal@gmail.com>
          Date: 2016-07-19T22:12:54Z

          Adding external libraries to livy


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user mfelgamal opened a pull request: https://github.com/apache/zeppelin/pull/1255 Adding extra libraries to livy What is this PR for? Adding extra libraries to livy interpreter which isn't exist by default. What type of PR is it? [ Improvement ] Todos [Test case ] - Task What is the Jira issue? ZEPPELIN-1258 How should this be tested? Create new livy interpreter or modify the default. Set `livy.spark.driver.extraClassPath` and `livy.spark.executor.extraClassPath` to path of libraries. Screenshots (if appropriate) ![]( https://s32.postimg.org/cxo94lzc5/livy_example_with_external_library.png ) ![]( https://s31.postimg.org/41gbe8hwr/add_Classpath_property_to_livy.png ) Questions: Does the licenses files need update? no Is there breaking changes for older versions? no Does this needs documentation? yes You can merge this pull request into a Git repository by running: $ git pull https://github.com/novelari/incubator-zeppelin feature/modifying-livy-doc Alternatively you can review and apply these changes as the patch at: https://github.com/apache/zeppelin/pull/1255.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1255 commit 2586651ab9768e484e04a840978d6db8d5659f48 Author: Fouad <fuad.assayadi@gmail.com> Date: 2016-05-29T14:39:08Z Merge pull request #2 from apache/master update from original commit 03a1e80f8f3115a75c42fa25fdaa06e7dd2cbc28 Author: mfelgamal <mahmoudf.elgamal@gmail.com> Date: 2016-07-19T18:28:46Z Merge pull request #4 from apache/master merge master commit 98090abc075b97e3896ae6ea0c6e48f57e8d6434 Author: mahmoudelgamal <mahmoudf.elgamal@gmail.com> Date: 2016-07-19T22:12:54Z Adding external libraries to livy
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user felixcheung commented on the issue:

          https://github.com/apache/zeppelin/pull/1255

          could you update the title of this PR and JIRA ZEPPELIN-1258, if we are changing how we would approach this?

          Show
          githubbot ASF GitHub Bot added a comment - Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1255 could you update the title of this PR and JIRA ZEPPELIN-1258 , if we are changing how we would approach this?
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user mfelgamal commented on the issue:

          https://github.com/apache/zeppelin/pull/1255

          @felixcheung do you have any further comments ?

          Show
          githubbot ASF GitHub Bot added a comment - Github user mfelgamal commented on the issue: https://github.com/apache/zeppelin/pull/1255 @felixcheung do you have any further comments ?
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user felixcheung commented on the issue:

          https://github.com/apache/zeppelin/pull/1255

          There is a test failure?

          Show
          githubbot ASF GitHub Bot added a comment - Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1255 There is a test failure?
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user mfelgamal commented on the issue:

          https://github.com/apache/zeppelin/pull/1255

          @felixcheung : This PR does not change the code. It is just a change in the configurations. So, it should not affect the tests

          Show
          githubbot ASF GitHub Bot added a comment - Github user mfelgamal commented on the issue: https://github.com/apache/zeppelin/pull/1255 @felixcheung : This PR does not change the code. It is just a change in the configurations. So, it should not affect the tests
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user felixcheung commented on the issue:

          https://github.com/apache/zeppelin/pull/1255

          That's a fair point.

          I'll merge if there is no more discussion.

          Show
          githubbot ASF GitHub Bot added a comment - Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1255 That's a fair point. I'll merge if there is no more discussion.
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user asfgit closed the pull request at:

          https://github.com/apache/zeppelin/pull/1255

          Show
          githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/1255

            People

            • Assignee:
              mfelgamal Mahmoud Elgamal
              Reporter:
              mahmoudf.elgamal Mahmoud Elgamal
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development