Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2100

Increase default batchSize of Morphline Solr Sink

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.1
    • Fix Version/s: 1.4.0
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      Increase default batchSize of Morphline Solr Sink from 100 to 1000. Based on performance testing.

      1. FLUME-2100-v1.patch
        0.8 kB
        wolfgang hoschek

        Activity

        Hide
        hudson Hudson added a comment -

        Integrated in flume-trunk #458 (See https://builds.apache.org/job/flume-trunk/458/)
        FLUME-2100. Increase default batchSize of Morphline Solr Sink. (Revision 5210b3163032e295d44416aa867cd5c5bbdb459a)

        Result = SUCCESS
        mpercy : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=5210b3163032e295d44416aa867cd5c5bbdb459a
        Files :

        • flume-ng-sinks/flume-ng-morphline-solr-sink/src/main/java/org/apache/flume/sink/solr/morphline/MorphlineSink.java
        Show
        hudson Hudson added a comment - Integrated in flume-trunk #458 (See https://builds.apache.org/job/flume-trunk/458/ ) FLUME-2100 . Increase default batchSize of Morphline Solr Sink. (Revision 5210b3163032e295d44416aa867cd5c5bbdb459a) Result = SUCCESS mpercy : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=5210b3163032e295d44416aa867cd5c5bbdb459a Files : flume-ng-sinks/flume-ng-morphline-solr-sink/src/main/java/org/apache/flume/sink/solr/morphline/MorphlineSink.java
        Hide
        mpercy Mike Percy added a comment -

        Pushed to trunk and flume-1.4 branches. Thanks for the patch Wolfgang!

        Show
        mpercy Mike Percy added a comment - Pushed to trunk and flume-1.4 branches. Thanks for the patch Wolfgang!
        Hide
        mpercy Mike Percy added a comment -

        +1, looks good to me. I'll pull this into 1.4.

        On a side note, I just realized this sink does not have user docs. Any plans to include that?

        Show
        mpercy Mike Percy added a comment - +1, looks good to me. I'll pull this into 1.4. On a side note, I just realized this sink does not have user docs. Any plans to include that?

          People

          • Assignee:
            whoschek wolfgang hoschek
            Reporter:
            whoschek wolfgang hoschek
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development