[FLUME-1972] ElasticSearchSink now allows the id of the document to be provided by a custom class

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.3.1
• Component/s: Sinks+Sources
• Assignee: Unassigned
• Reporter: Edward Sargisson
• Created: 05/Apr/13 18:37
• Updated: 23/Jun/13 20:56
• Resolved: 26/Apr/13 21:17

Description

Sometimes, you want to set the id on the document that is being written to elasticsearch so that you can later search by that id or overwrite previous versions of the same document (as they have the same id).

This enhancement allows developers to provide a custom class that can read the incoming Avro event and determine the ID from it.

We currently have this enhancement working successfully against Flume 1.3.1. A patch against trunk will be provided shortly.

Issue Links

• is related to: FLUME-2015 ElasticSearchSink: need access to IndexRequestBuilder instance during flume event processing
• links to: Review Board