[FLINK-4491] Handle index.number_of_shards in the ES connector

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 1.1.0
• Component/s: Connectors / Common
• Labels: elasticsearch streaming
• Assignee: Unassigned
• Reporter: Flavio Pompermaier
• Created: 25/Aug/16 14:39
• Updated: 12/Mar/20 13:02
• Resolved: 12/Mar/20 13:02

Description

At the moment is not possible to configure the number of shards if an index does not already exists on the Elasticsearch cluster. It could be a great improvement to handle the index.number_of_shards (passed in the configuration object). E.g.:

Map<String, String> config = Maps.newHashMap();
config.put("bulk.flush.max.actions", "1");
config.put("cluster.name", "my-cluster-name");
config.put("index.number_of_shards", "1");

Issue Links

• links to: GitHub Pull Request #2790