Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.6.0
    • Component/s: None
    • Labels:
      None

      Description

      In order to use Hive's JDBC driver you have to install quite a lot of stuff. A hive-jdbc package that installed only the required libraries would be nice for client-side installs.

        Activity

        Hide
        Sean Mackrory added a comment -

        Retroactive +1! Thanks Mark.

        Show
        Sean Mackrory added a comment - Retroactive +1! Thanks Mark.
        Hide
        Mark Grover added a comment -

        Thanks Sean and Roman!

        Show
        Mark Grover added a comment - Thanks Sean and Roman!
        Hide
        Roman Shaposhnik added a comment -

        +1 and committed!

        Show
        Roman Shaposhnik added a comment - +1 and committed!
        Hide
        Mark Grover added a comment -

        Attached my patch. For easier review, the difference between the first and second patch is here:

        diff --git a/bigtop-packages/src/deb/hive/control b/bigtop-packages/src/deb/hive/control
        index 08eae1d..8cddf2a 100644
        --- a/bigtop-packages/src/deb/hive/control
        +++ b/bigtop-packages/src/deb/hive/control
        @@ -23,7 +23,7 @@ Homepage: http://hive.apache.org/
         
         Package: hive
         Architecture: all
        -Depends: adduser, bigtop-utils (>= 0.6), zookeeper
        +Depends: adduser, hadoop-client, bigtop-utils (>= 0.6), zookeeper, hive-jdbc
         Description: Hive is a data warehouse infrastructure built on top of Hadoop
          Hive is a data warehouse infrastructure built on top of Hadoop that provides
          tools to enable easy data summarization, adhoc querying and analysis of large
        diff --git a/bigtop-packages/src/rpm/hive/SPECS/hive.spec b/bigtop-packages/src/rpm/hive/SPECS/hive.spec
        index a785a1f..021bc5f 100644
        --- a/bigtop-packages/src/rpm/hive/SPECS/hive.spec
        +++ b/bigtop-packages/src/rpm/hive/SPECS/hive.spec
        @@ -71,7 +71,7 @@ Source7: hive.1
         Source8: hive-site.xml
         Source9: hive-server.svc
         Source10: hive-metastore.svc
        -Requires: bigtop-utils >= 0.6, hbase, zookeeper, hive-jdbc
        +Requires: hadoop-client, bigtop-utils >= 0.6, hbase, zookeeper, hive-jdbc
         Obsoletes: %{name}-webinterface
         
         %description 
        

        I would personally love to see this go into Bigtop 0.6 since it will really benefit Hive users. They wouldn't have to install the entire hive package if they just wanted to access hive via JDBC. Any chance we can include this in Bigtop 0.6? Much appreciated!

        Show
        Mark Grover added a comment - Attached my patch. For easier review, the difference between the first and second patch is here: diff --git a/bigtop-packages/src/deb/hive/control b/bigtop-packages/src/deb/hive/control index 08eae1d..8cddf2a 100644 --- a/bigtop-packages/src/deb/hive/control +++ b/bigtop-packages/src/deb/hive/control @@ -23,7 +23,7 @@ Homepage: http: //hive.apache.org/ Package: hive Architecture: all -Depends: adduser, bigtop-utils (>= 0.6), zookeeper +Depends: adduser, hadoop-client, bigtop-utils (>= 0.6), zookeeper, hive-jdbc Description: Hive is a data warehouse infrastructure built on top of Hadoop Hive is a data warehouse infrastructure built on top of Hadoop that provides tools to enable easy data summarization, adhoc querying and analysis of large diff --git a/bigtop-packages/src/rpm/hive/SPECS/hive.spec b/bigtop-packages/src/rpm/hive/SPECS/hive.spec index a785a1f..021bc5f 100644 --- a/bigtop-packages/src/rpm/hive/SPECS/hive.spec +++ b/bigtop-packages/src/rpm/hive/SPECS/hive.spec @@ -71,7 +71,7 @@ Source7: hive.1 Source8: hive-site.xml Source9: hive-server.svc Source10: hive-metastore.svc -Requires: bigtop-utils >= 0.6, hbase, zookeeper, hive-jdbc +Requires: hadoop-client, bigtop-utils >= 0.6, hbase, zookeeper, hive-jdbc Obsoletes: %{name}-webinterface %description I would personally love to see this go into Bigtop 0.6 since it will really benefit Hive users. They wouldn't have to install the entire hive package if they just wanted to access hive via JDBC. Any chance we can include this in Bigtop 0.6? Much appreciated!
        Hide
        Mark Grover added a comment -

        I noticed that hive package was missing a dependency on hive-jdbc in deb/hive/rules file. Also, I personally think that it's safer (and doesn't cause any harm) to explicitly list out hadoop-client as a dependency of hive package even though it will transitively come through hive-jdbc package.

        So, I took the liberty of creating a new patch with the above two changes and will upload it soon.

        Show
        Mark Grover added a comment - I noticed that hive package was missing a dependency on hive-jdbc in deb/hive/rules file. Also, I personally think that it's safer (and doesn't cause any harm) to explicitly list out hadoop-client as a dependency of hive package even though it will transitively come through hive-jdbc package. So, I took the liberty of creating a new patch with the above two changes and will upload it soon.
        Hide
        Sean Mackrory added a comment -

        Tested this this morning using this procedure: https://cwiki.apache.org/Hive/hiveclient.html. Ran into some Hive configuration issues I'm still learning my way through, but the instantiation of the driver works and basic database operations have been carried out over it. The main changes from my initial patch are the inclusion of hadoop-client as a dependency for hive-jdbc instead of just hive, and the includiong of 2 more hive libraries that turned out to be necessary.

        Show
        Sean Mackrory added a comment - Tested this this morning using this procedure: https://cwiki.apache.org/Hive/hiveclient.html . Ran into some Hive configuration issues I'm still learning my way through, but the instantiation of the driver works and basic database operations have been carried out over it. The main changes from my initial patch are the inclusion of hadoop-client as a dependency for hive-jdbc instead of just hive, and the includiong of 2 more hive libraries that turned out to be necessary.
        Hide
        Sean Mackrory added a comment -

        I have not actually tested this at run-time yet, but the packages that result appear to be correct. Just attaching this now in case anyone has any feedback on the approach.

        Show
        Sean Mackrory added a comment - I have not actually tested this at run-time yet, but the packages that result appear to be correct. Just attaching this now in case anyone has any feedback on the approach.

          People

          • Assignee:
            Sean Mackrory
            Reporter:
            Sean Mackrory
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development