Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1972

ElasticSearchSink now allows the id of the document to be provided by a custom class

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.3.1
    • None
    • Sinks+Sources
    • None

    Description

      Sometimes, you want to set the id on the document that is being written to elasticsearch so that you can later search by that id or overwrite previous versions of the same document (as they have the same id).

      This enhancement allows developers to provide a custom class that can read the incoming Avro event and determine the ID from it.

      We currently have this enhancement working successfully against Flume 1.3.1. A patch against trunk will be provided shortly.

      Attachments

        1. FLUME-1972-1.4.0.patch
          14 kB
          Edward Sargisson
        2. FLUME-1972-1.4.0-1.patch
          17 kB
          Edward Sargisson
        3. FLUME-1972-1.4.0-2.patch
          4 kB
          Edward Sargisson
        4. FLUME-1972-1.4.0-3.patch
          24 kB
          Edward Sargisson
        5. FLUME-1972-1.4.0-4.patch
          24 kB
          Edward Sargisson

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ejsarge Edward Sargisson
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: