Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2670

Modify dependencies to not pull hadoop/hive related jars

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.0
    • Component/s: None
    • Labels:
      None

      Description

      Recent changes to kite-sdk and flume-ng-auth modules, have introduced hadoop and hive dependency jars to be pulled in the flume distribution.

      Working/testing on a patch, will upload soon

        Activity

        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Flume-trunk-hbase-98 #91 (See https://builds.apache.org/job/Flume-trunk-hbase-98/91/)
        FLUME-2670. Modify dependencies to not pull hadoop/hive related jars (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=275329ca6c5ebd5212879696fcd0d19f691c1b60)

        • flume-ng-sinks/flume-dataset-sink/pom.xml
        • flume-ng-auth/pom.xml
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Flume-trunk-hbase-98 #91 (See https://builds.apache.org/job/Flume-trunk-hbase-98/91/ ) FLUME-2670 . Modify dependencies to not pull hadoop/hive related jars (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=275329ca6c5ebd5212879696fcd0d19f691c1b60 ) flume-ng-sinks/flume-dataset-sink/pom.xml flume-ng-auth/pom.xml
        Hide
        hshreedharan Hari Shreedharan added a comment -

        Committed! Thanks Johny!

        Show
        hshreedharan Hari Shreedharan added a comment - Committed! Thanks Johny!
        Hide
        hshreedharan Hari Shreedharan added a comment -

        that should be tracked separately. We should not be pulling in unrelated changes into the same commit.

        Show
        hshreedharan Hari Shreedharan added a comment - that should be tracked separately. We should not be pulling in unrelated changes into the same commit.
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 636cff349a0012c2fd56525d0a69eb5a95610ea4 in flume's branch refs/heads/flume-1.6 from Hari Shreedharan
        [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=636cff3 ]

        FLUME-2670. Modify dependencies to not pull hadoop/hive related jars

        (Johny Rufus via Hari)

        Show
        jira-bot ASF subversion and git services added a comment - Commit 636cff349a0012c2fd56525d0a69eb5a95610ea4 in flume's branch refs/heads/flume-1.6 from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=636cff3 ] FLUME-2670 . Modify dependencies to not pull hadoop/hive related jars (Johny Rufus via Hari)
        Hide
        jrufus Johny Rufus added a comment -

        W/o the change to TestLog.java, the build was failing

        Show
        jrufus Johny Rufus added a comment - W/o the change to TestLog.java, the build was failing
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 275329ca6c5ebd5212879696fcd0d19f691c1b60 in flume's branch refs/heads/trunk from Hari Shreedharan
        [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=275329c ]

        FLUME-2670. Modify dependencies to not pull hadoop/hive related jars

        (Johny Rufus via Hari)

        Show
        jira-bot ASF subversion and git services added a comment - Commit 275329ca6c5ebd5212879696fcd0d19f691c1b60 in flume's branch refs/heads/trunk from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=275329c ] FLUME-2670 . Modify dependencies to not pull hadoop/hive related jars (Johny Rufus via Hari)
        Hide
        hshreedharan Hari Shreedharan added a comment -

        +1. I removed the change made to TestLog.java though.

        Show
        hshreedharan Hari Shreedharan added a comment - +1. I removed the change made to TestLog.java though.
        Hide
        hshreedharan Hari Shreedharan added a comment -

        Sorry, assigned to myself by mistake.

        Show
        hshreedharan Hari Shreedharan added a comment - Sorry, assigned to myself by mistake.
        Hide
        jrufus Johny Rufus added a comment -

        Made the following changes
        1 - made flume-ng-auth hadoop-common dependency as optional
        2 - made hive-exec and hive-metastore dependecy in kite dataset sink as optional
        3 - removed unused import introduced in TestLog.java, one of the recent commits that depends on hadoop-common

        Hari Shreedharan, can you let me know if the patch is fine, and making the above as optional is fine

        Show
        jrufus Johny Rufus added a comment - Made the following changes 1 - made flume-ng-auth hadoop-common dependency as optional 2 - made hive-exec and hive-metastore dependecy in kite dataset sink as optional 3 - removed unused import introduced in TestLog.java, one of the recent commits that depends on hadoop-common Hari Shreedharan , can you let me know if the patch is fine, and making the above as optional is fine

          People

          • Assignee:
            jrufus Johny Rufus
            Reporter:
            jrufus Johny Rufus
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development