Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2015

ElasticSearchSink: need access to IndexRequestBuilder instance during flume event processing

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.3.0, 1.3.1
    • 1.4.0
    • Sinks+Sources
    • None

    Description

      I need more control over the indexing performed by the ElasticSearchSink – in particular I need access to an IndexRequestBuilder instance during flume event processing. The interactions between ElasticSearchSink and ElasticSearchEventSerializer currently do not make this possible.

      I have authored a patch that meets my needs and maintains backwards-compatibility for existing users of the sink. It is available at https://github.com/prime8/flume/commit/1056c129b10c95cee50e0c3f77e309668f82bfc6 – please let me know if it can be pulled into the main ASF source tree!

      Thanks

      Attachments

        1. FLUME-2015-1.4.0-0.patch
          31 kB
          Tim Bacon
        2. FLUME-2015-doc-1.4.0-0.patch
          7 kB
          Edward Sargisson
        3. FLUME-2015-1.4.0-1.patch
          34 kB
          Tim Bacon
        4. FLUME-2015-1.4.0-01.patch
          14 kB
          Tim Bacon
        5. FLUME-2015-2.patch
          22 kB
          Mike Percy

        Issue Links

          Activity

            People

              prime8 Tim Bacon
              prime8 Tim Bacon
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: