[FLUME-2758] Shield Support for Elasticsearch Sink

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.6.0
• Labels: client elasticsearch rest shield
• Release Note: Added basic authentication for authenticating to elasticsearch with shield.
• Assignee: Dario Lombardo
• Reporter: Jared Ramsey
• Created: 05/Aug/15 14:02
• Updated: 08/Oct/22 17:35
• Resolved: 08/Oct/22 17:35

Description

The existing Elasticsearch sink does not support Elasticsearch clusters that have been secured with Shield. (See https://www.elastic.co/products/shield) All that would be required to add this support is allowing users to configure the username and password on the sink in their flume.conf and then setting the username and password on the HTTP header like so:

UsernamePasswordCredentials creds = new UsernamePasswordCredentials("username", "password");
HttpPost httpRequest = new HttpPost(url);
httpRequest.addHeader(new BasicScheme().authenticate(creds, httpRequest));

I've already hard-coded a quick fix for myself that works, but it would be awesome to see this in a future release and/or patch.