Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2324

Support writing to multiple HBase clusters using HBaseSink

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.5.0
    • Component/s: None
    • Labels:
      None

      Description

      The AsyncHBaseSink can already write to multiple HBase clusters, but HBaseSink cannot.

      1. FLUME-2324.patch
        8 kB
        Hari Shreedharan
      2. FLUME-2324-2.patch
        9 kB
        Hari Shreedharan

        Activity

        Hide
        gopinathan.av Gopinathan A added a comment -

        +1 for patch.

        Small suggestion , please update this patch with FlumeUserGuide documentation, also better to mention configuration precedence.

        Show
        gopinathan.av Gopinathan A added a comment - +1 for patch. Small suggestion , please update this patch with FlumeUserGuide documentation, also better to mention configuration precedence.
        Hide
        jarcec Jarek Jarcec Cecho added a comment -

        Couple of nits:

        • I've noticed that this fragment is in the code twice, perhaps we should have it only once?
                logger.info("Using ZK Quorum: " + zkQuorum);
          
        • Do you think that you could update the user guide with this argument? It seems that we have currently documented the zookeeperQuorum only for AsyncHBaseSink.
        Show
        jarcec Jarek Jarcec Cecho added a comment - Couple of nits: I've noticed that this fragment is in the code twice, perhaps we should have it only once? logger.info( "Using ZK Quorum: " + zkQuorum); Do you think that you could update the user guide with this argument? It seems that we have currently documented the zookeeperQuorum only for AsyncHBaseSink.
        Hide
        hshreedharan Hari Shreedharan added a comment -

        Thanks for the review, Jarcec. Will update the patch.

        Show
        hshreedharan Hari Shreedharan added a comment - Thanks for the review, Jarcec. Will update the patch.
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 96f6b6284c6e8a645b122111059ee954e9bad7b5 in flume's branch refs/heads/trunk from Jarek Jarcec Cecho
        [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=96f6b62 ]

        FLUME-2324: Support writing to multiple HBase clusters using HBaseSink

        (Hari Shreedharan via Jarek Jarcec Cecho)

        Show
        jira-bot ASF subversion and git services added a comment - Commit 96f6b6284c6e8a645b122111059ee954e9bad7b5 in flume's branch refs/heads/trunk from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=96f6b62 ] FLUME-2324 : Support writing to multiple HBase clusters using HBaseSink (Hari Shreedharan via Jarek Jarcec Cecho)
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 962f5fbe2039773cc00928ac2e42ee813669270a in flume's branch refs/heads/flume-1.5 from Jarek Jarcec Cecho
        [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=962f5fb ]

        FLUME-2324: Support writing to multiple HBase clusters using HBaseSink

        (Hari Shreedharan via Jarek Jarcec Cecho)

        Show
        jira-bot ASF subversion and git services added a comment - Commit 962f5fbe2039773cc00928ac2e42ee813669270a in flume's branch refs/heads/flume-1.5 from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=962f5fb ] FLUME-2324 : Support writing to multiple HBase clusters using HBaseSink (Hari Shreedharan via Jarek Jarcec Cecho)
        Hide
        jarcec Jarek Jarcec Cecho added a comment -

        Thank you for your contribution Hari Shreedharan!

        Show
        jarcec Jarek Jarcec Cecho added a comment - Thank you for your contribution Hari Shreedharan !
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in flume-trunk #556 (See https://builds.apache.org/job/flume-trunk/556/)
        FLUME-2324: Support writing to multiple HBase clusters using HBaseSink (jarcec: http://git-wip-us.apache.org/repos/asf/flume/repo/?p=flume.git&a=commit&h=96f6b6284c6e8a645b122111059ee954e9bad7b5)

        • flume-ng-doc/sphinx/FlumeUserGuide.rst
        • flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java
        • flume-ng-sinks/flume-ng-hbase-sink/src/test/java/org/apache/flume/sink/hbase/TestHBaseSink.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in flume-trunk #556 (See https://builds.apache.org/job/flume-trunk/556/ ) FLUME-2324 : Support writing to multiple HBase clusters using HBaseSink (jarcec: http://git-wip-us.apache.org/repos/asf/flume/repo/?p=flume.git&a=commit&h=96f6b6284c6e8a645b122111059ee954e9bad7b5 ) flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HBaseSink.java flume-ng-sinks/flume-ng-hbase-sink/src/test/java/org/apache/flume/sink/hbase/TestHBaseSink.java

          People

          • Assignee:
            hshreedharan Hari Shreedharan
            Reporter:
            hshreedharan Hari Shreedharan
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development