Flume
  1. Flume
  2. FLUME-2015

ElasticSearchSink: need access to IndexRequestBuilder instance during flume event processing

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.3.0, v1.3.1
    • Fix Version/s: v1.4.0
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      I need more control over the indexing performed by the ElasticSearchSink – in particular I need access to an IndexRequestBuilder instance during flume event processing. The interactions between ElasticSearchSink and ElasticSearchEventSerializer currently do not make this possible.

      I have authored a patch that meets my needs and maintains backwards-compatibility for existing users of the sink. It is available at https://github.com/prime8/flume/commit/1056c129b10c95cee50e0c3f77e309668f82bfc6 – please let me know if it can be pulled into the main ASF source tree!

      Thanks

      1. FLUME-2015-2.patch
        22 kB
        Mike Percy
      2. FLUME-2015-1.4.0-01.patch
        14 kB
        Tim Bacon
      3. FLUME-2015-1.4.0-1.patch
        34 kB
        Tim Bacon
      4. FLUME-2015-doc-1.4.0-0.patch
        7 kB
        Edward Sargisson
      5. FLUME-2015-1.4.0-0.patch
        31 kB
        Tim Bacon

        Issue Links

          Activity

          Mike Percy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Assignee Tim Bacon [ prime8 ]
          Fix Version/s v1.4.0 [ 12323372 ]
          Resolution Fixed [ 1 ]
          Mike Percy made changes -
          Attachment FLUME-2015-2.patch [ 12582674 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-01.patch [ 12582445 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-1.patch [ 12582443 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-1.patch [ 12582444 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-1.patch [ 12582443 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-1.patch [ 12582438 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-01.patch [ 12582437 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-1.patch [ 12582438 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-01.patch [ 12582437 ]
          Tim Bacon made changes -
          Remote Link This issue links to "Code Review Board (Web Link)" [ 12184 ]
          Edward Sargisson made changes -
          Remote Link This issue links to "Documentation Review Board (Web Link)" [ 12178 ]
          Edward Sargisson made changes -
          Link This issue is related to FLUME-1992 [ FLUME-1992 ]
          Edward Sargisson made changes -
          Attachment FLUME-2015-doc-1.4.0-0.patch [ 12580749 ]
          Tim Bacon made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tim Bacon made changes -
          Attachment FLUME-2015-1.4.0-0.patch [ 12580646 ]
          Edward Sargisson made changes -
          Link This issue relates to FLUME-1972 [ FLUME-1972 ]
          Mike Percy made changes -
          Field Original Value New Value
          Link This issue is related to FLUME-1782 [ FLUME-1782 ]
          Tim Bacon created issue -

            People

            • Assignee:
              Tim Bacon
              Reporter:
              Tim Bacon
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development