Flume
  1. Flume
  2. FLUME-2015

ElasticSearchSink: need access to IndexRequestBuilder instance during flume event processing

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.3.0, v1.3.1
    • Fix Version/s: v1.4.0
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      I need more control over the indexing performed by the ElasticSearchSink – in particular I need access to an IndexRequestBuilder instance during flume event processing. The interactions between ElasticSearchSink and ElasticSearchEventSerializer currently do not make this possible.

      I have authored a patch that meets my needs and maintains backwards-compatibility for existing users of the sink. It is available at https://github.com/prime8/flume/commit/1056c129b10c95cee50e0c3f77e309668f82bfc6 – please let me know if it can be pulled into the main ASF source tree!

      Thanks

      1. FLUME-2015-doc-1.4.0-0.patch
        7 kB
        Edward Sargisson
      2. FLUME-2015-2.patch
        22 kB
        Mike Percy
      3. FLUME-2015-1.4.0-1.patch
        34 kB
        Tim Bacon
      4. FLUME-2015-1.4.0-01.patch
        14 kB
        Tim Bacon
      5. FLUME-2015-1.4.0-0.patch
        31 kB
        Tim Bacon

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Tim Bacon
              Reporter:
              Tim Bacon
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development