Flume
  1. Flume
  2. FLUME-1198

Implement a load-balancing sink processor

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      A load-balancing sink processor that can distribute the load over multiple sinks. The distribution of load could be round/robin or random, preferably configurable to support both.

      1. FLUME-1198-3.patch
        34 kB
        Arvind Prabhakar
      2. FLUME-1198-2.patch
        34 kB
        Arvind Prabhakar
      3. BalancingSinkProcessor.java
        7 kB
        Juhani Connolly

        Activity

        Hide
        Juhani Connolly added a comment -

        I'd been meaning to do this anyway. I'll get a prototype up soon

        Show
        Juhani Connolly added a comment - I'd been meaning to do this anyway. I'll get a prototype up soon
        Hide
        Arvind Prabhakar added a comment -

        Juhani, appreciate your help with this. If you have not yet started working on this I would prefer to pick it up as I already have some code written for it. Sorry for not putting on my queue as I filed.

        Show
        Arvind Prabhakar added a comment - Juhani, appreciate your help with this. If you have not yet started working on this I would prefer to pick it up as I already have some code written for it. Sorry for not putting on my queue as I filed.
        Hide
        Juhani Connolly added a comment -

        Ok, sure. I got some basic work done, but am fine with you doing it. I'll just review it when it's done. Feel free to reassign it.

        Show
        Juhani Connolly added a comment - Ok, sure. I got some basic work done, but am fine with you doing it. I'll just review it when it's done. Feel free to reassign it.
        Hide
        Juhani Connolly added a comment -

        fwiw, this is the work I'd done so far, maybe you can find a use for it.

        The basic plan was to supply a couple of basic balancers and leave it open to pluggable balancers.

        Show
        Juhani Connolly added a comment - fwiw, this is the work I'd done so far, maybe you can find a use for it. The basic plan was to supply a couple of basic balancers and leave it open to pluggable balancers.
        Hide
        Arvind Prabhakar added a comment -

        Thanks Juhani for sharing the work you did on this. I took a slightly different route and have posted my patch for review.

        Show
        Arvind Prabhakar added a comment - Thanks Juhani for sharing the work you did on this. I took a slightly different route and have posted my patch for review.
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/5161/
        -----------------------------------------------------------

        (Updated 2012-05-18 08:02:10.859912)

        Review request for Flume and Juhani Connolly.

        Changes
        -------

        Added Jira link.

        Summary
        -------

        Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics.

        Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks.

        This addresses bug FLUME-1198.
        https://issues.apache.org/jira/browse/FLUME-1198

        Diffs


        /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941
        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION
        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION
        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941
        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION
        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION
        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941
        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION

        Diff: https://reviews.apache.org/r/5161/diff

        Testing
        -------

        Introduced new tests and ran all existing tests.

        Thanks,

        Arvind

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5161/ ----------------------------------------------------------- (Updated 2012-05-18 08:02:10.859912) Review request for Flume and Juhani Connolly. Changes ------- Added Jira link. Summary ------- Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics. Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks. This addresses bug FLUME-1198 . https://issues.apache.org/jira/browse/FLUME-1198 Diffs /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941 /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION Diff: https://reviews.apache.org/r/5161/diff Testing ------- Introduced new tests and ran all existing tests. Thanks, Arvind
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/5161/#review7973
        -----------------------------------------------------------

        Thank you for the patch! Looks good in general, just two issues below.

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java
        <https://reviews.apache.org/r/5161/#comment17321>

        remove codegen

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java
        <https://reviews.apache.org/r/5161/#comment17320>

        We want to be checking s1..s0 as opposed to s1 and s3?

        • Brock

        On 2012-05-18 08:02:10, Arvind Prabhakar wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/5161/

        -----------------------------------------------------------

        (Updated 2012-05-18 08:02:10)

        Review request for Flume and Juhani Connolly.

        Summary

        -------

        Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics.

        Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks.

        This addresses bug FLUME-1198.

        https://issues.apache.org/jira/browse/FLUME-1198

        Diffs

        -----

        /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION

        Diff: https://reviews.apache.org/r/5161/diff

        Testing

        -------

        Introduced new tests and ran all existing tests.

        Thanks,

        Arvind

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5161/#review7973 ----------------------------------------------------------- Thank you for the patch! Looks good in general, just two issues below. /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java < https://reviews.apache.org/r/5161/#comment17321 > remove codegen /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java < https://reviews.apache.org/r/5161/#comment17320 > We want to be checking s1..s0 as opposed to s1 and s3? Brock On 2012-05-18 08:02:10, Arvind Prabhakar wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5161/ ----------------------------------------------------------- (Updated 2012-05-18 08:02:10) Review request for Flume and Juhani Connolly. Summary ------- Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics. Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks. This addresses bug FLUME-1198 . https://issues.apache.org/jira/browse/FLUME-1198 Diffs ----- /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941 /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION Diff: https://reviews.apache.org/r/5161/diff Testing ------- Introduced new tests and ran all existing tests. Thanks, Arvind
        Hide
        jiraposter@reviews.apache.org added a comment -

        On 2012-05-18 16:56:42, Brock Noland wrote:

        > /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java, line 37

        > <https://reviews.apache.org/r/5161/diff/2/?file=109548#file109548line37>

        >

        > remove codegen

        done.

        On 2012-05-18 16:56:42, Brock Noland wrote:

        > /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java, line 247

        > <https://reviews.apache.org/r/5161/diff/2/?file=109553#file109553line247>

        >

        > We want to be checking s1..s0 as opposed to s1 and s3?

        thanks for catching this Brock! Will fix it right away.

        • Arvind

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/5161/#review7973
        -----------------------------------------------------------

        On 2012-05-18 08:02:10, Arvind Prabhakar wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/5161/

        -----------------------------------------------------------

        (Updated 2012-05-18 08:02:10)

        Review request for Flume and Juhani Connolly.

        Summary

        -------

        Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics.

        Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks.

        This addresses bug FLUME-1198.

        https://issues.apache.org/jira/browse/FLUME-1198

        Diffs

        -----

        /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION

        Diff: https://reviews.apache.org/r/5161/diff

        Testing

        -------

        Introduced new tests and ran all existing tests.

        Thanks,

        Arvind

        Show
        jiraposter@reviews.apache.org added a comment - On 2012-05-18 16:56:42, Brock Noland wrote: > /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java, line 37 > < https://reviews.apache.org/r/5161/diff/2/?file=109548#file109548line37 > > > remove codegen done. On 2012-05-18 16:56:42, Brock Noland wrote: > /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java, line 247 > < https://reviews.apache.org/r/5161/diff/2/?file=109553#file109553line247 > > > We want to be checking s1..s0 as opposed to s1 and s3? thanks for catching this Brock! Will fix it right away. Arvind ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5161/#review7973 ----------------------------------------------------------- On 2012-05-18 08:02:10, Arvind Prabhakar wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5161/ ----------------------------------------------------------- (Updated 2012-05-18 08:02:10) Review request for Flume and Juhani Connolly. Summary ------- Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics. Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks. This addresses bug FLUME-1198 . https://issues.apache.org/jira/browse/FLUME-1198 Diffs ----- /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941 /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION Diff: https://reviews.apache.org/r/5161/diff Testing ------- Introduced new tests and ran all existing tests. Thanks, Arvind
        Hide
        Arvind Prabhakar added a comment -

        Attached the latest patch from RB.

        Show
        Arvind Prabhakar added a comment - Attached the latest patch from RB.
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/5161/
        -----------------------------------------------------------

        (Updated 2012-05-18 17:33:45.327838)

        Review request for Flume and Juhani Connolly.

        Changes
        -------

        Incorporated the review feedback and modified one of the testcase that had a very strict assertion for a state that had high probability of happening.

        Ran all the tests.

        Summary
        -------

        Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics.

        Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks.

        This addresses bug FLUME-1198.
        https://issues.apache.org/jira/browse/FLUME-1198

        Diffs (updated)


        /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941
        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION
        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION
        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941
        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION
        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION
        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941
        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION

        Diff: https://reviews.apache.org/r/5161/diff

        Testing
        -------

        Introduced new tests and ran all existing tests.

        Thanks,

        Arvind

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5161/ ----------------------------------------------------------- (Updated 2012-05-18 17:33:45.327838) Review request for Flume and Juhani Connolly. Changes ------- Incorporated the review feedback and modified one of the testcase that had a very strict assertion for a state that had high probability of happening. Ran all the tests. Summary ------- Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics. Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks. This addresses bug FLUME-1198 . https://issues.apache.org/jira/browse/FLUME-1198 Diffs (updated) /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941 /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION Diff: https://reviews.apache.org/r/5161/diff Testing ------- Introduced new tests and ran all existing tests. Thanks, Arvind
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/5161/#review7979
        -----------------------------------------------------------

        Ship it!

        lgtm

        • Brock

        On 2012-05-18 17:33:45, Arvind Prabhakar wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/5161/

        -----------------------------------------------------------

        (Updated 2012-05-18 17:33:45)

        Review request for Flume and Juhani Connolly.

        Summary

        -------

        Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics.

        Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks.

        This addresses bug FLUME-1198.

        https://issues.apache.org/jira/browse/FLUME-1198

        Diffs

        -----

        /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941

        /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941

        /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION

        Diff: https://reviews.apache.org/r/5161/diff

        Testing

        -------

        Introduced new tests and ran all existing tests.

        Thanks,

        Arvind

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5161/#review7979 ----------------------------------------------------------- Ship it! lgtm Brock On 2012-05-18 17:33:45, Arvind Prabhakar wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5161/ ----------------------------------------------------------- (Updated 2012-05-18 17:33:45) Review request for Flume and Juhani Connolly. Summary ------- Added a load-balancing sink processor that uses default round-robin policy to select sinks from the group. In case of failure, it skips the sink and goes to the next. Can be configured to use random distribution of load instead of default round-robin semantics. Also, this processor accepts implementations of sink selectors which can be used to route the load into various sinks. This addresses bug FLUME-1198 . https://issues.apache.org/jira/browse/FLUME-1198 Diffs ----- /trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java PRE-CREATION /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java 1339941 /trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java PRE-CREATION /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java 1339941 /trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java PRE-CREATION Diff: https://reviews.apache.org/r/5161/diff Testing ------- Introduced new tests and ran all existing tests. Thanks, Arvind
        Hide
        Brock Noland added a comment -

        Committed in 1340222!

        Show
        Brock Noland added a comment - Committed in 1340222!
        Hide
        Hudson added a comment -

        Integrated in flume-trunk #207 (See https://builds.apache.org/job/flume-trunk/207/)
        FLUME-1198: Implement a load balancing sink processor

        (Arvind Prabhakar via Brock Noland) (Revision 1340222)

        Result = SUCCESS
        brock : http://svn.apache.org/viewvc/?view=rev&rev=1340222
        Files :

        • /incubator/flume/trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java
        • /incubator/flume/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java
        • /incubator/flume/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java
        • /incubator/flume/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java
        • /incubator/flume/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java
        • /incubator/flume/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java
        • /incubator/flume/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java
        • /incubator/flume/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java
        Show
        Hudson added a comment - Integrated in flume-trunk #207 (See https://builds.apache.org/job/flume-trunk/207/ ) FLUME-1198 : Implement a load balancing sink processor (Arvind Prabhakar via Brock Noland) (Revision 1340222) Result = SUCCESS brock : http://svn.apache.org/viewvc/?view=rev&rev=1340222 Files : /incubator/flume/trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java /incubator/flume/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java /incubator/flume/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java /incubator/flume/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java /incubator/flume/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java /incubator/flume/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java /incubator/flume/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java /incubator/flume/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java

          People

          • Assignee:
            Arvind Prabhakar
            Reporter:
            Arvind Prabhakar
          • Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development