Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2015

ElasticSearchSink: need access to IndexRequestBuilder instance during flume event processing

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 1.3.1
    • Fix Version/s: 1.4.0
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      I need more control over the indexing performed by the ElasticSearchSink – in particular I need access to an IndexRequestBuilder instance during flume event processing. The interactions between ElasticSearchSink and ElasticSearchEventSerializer currently do not make this possible.

      I have authored a patch that meets my needs and maintains backwards-compatibility for existing users of the sink. It is available at https://github.com/prime8/flume/commit/1056c129b10c95cee50e0c3f77e309668f82bfc6 – please let me know if it can be pulled into the main ASF source tree!

      Thanks

        Attachments

        1. FLUME-2015-1.4.0-0.patch
          31 kB
          Tim Bacon
        2. FLUME-2015-1.4.0-01.patch
          14 kB
          Tim Bacon
        3. FLUME-2015-1.4.0-1.patch
          34 kB
          Tim Bacon
        4. FLUME-2015-2.patch
          22 kB
          Mike Percy
        5. FLUME-2015-doc-1.4.0-0.patch
          7 kB
          Edward Sargisson

        Issue Links

          Activity

            People

            • Assignee:
              prime8 Tim Bacon
              Reporter:
              prime8 Tim Bacon

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment