Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2015

ElasticSearchSink: need access to IndexRequestBuilder instance during flume event processing

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 1.3.1
    • Fix Version/s: 1.4.0
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      I need more control over the indexing performed by the ElasticSearchSink – in particular I need access to an IndexRequestBuilder instance during flume event processing. The interactions between ElasticSearchSink and ElasticSearchEventSerializer currently do not make this possible.

      I have authored a patch that meets my needs and maintains backwards-compatibility for existing users of the sink. It is available at https://github.com/prime8/flume/commit/1056c129b10c95cee50e0c3f77e309668f82bfc6 – please let me know if it can be pulled into the main ASF source tree!

      Thanks

        Attachments

        1. FLUME-2015-2.patch
          22 kB
          Mike Percy
        2. FLUME-2015-1.4.0-01.patch
          14 kB
          Tim Bacon
        3. FLUME-2015-1.4.0-1.patch
          34 kB
          Tim Bacon
        4. FLUME-2015-doc-1.4.0-0.patch
          7 kB
          Edward Sargisson
        5. FLUME-2015-1.4.0-0.patch
          31 kB
          Tim Bacon

          Issue Links

            Activity

              People

              • Assignee:
                prime8 Tim Bacon
                Reporter:
                prime8 Tim Bacon
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: