[FLINK-16788] Support username and password options for Elasticsearch SQL connector

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Affects Version/s: 1.10.0
• Fix Version/s: 1.12.0
• Component/s: Connectors / ElasticSearch, Table SQL / API
• Labels: pull-request-available
• Release Note: Resolved in https://issues.apache.org/jira/browse/FLINK-18361
• Assignee: zhisheng
• Reporter: zhisheng
• Created: 26/Mar/20 03:05
• Updated: 08/Dec/20 02:35
• Resolved: 27/Sep/20 01:24

Description

In a production environment, accessing elasticsearch usually requires authentication, and requires a username and password to access it, but the current version of SQL DDL does not support users to configure these parameters.

 

I have improve it in our company, and we use it as follows:

 
CREATE TABLE user_behavior_es (
    user_idBIGINT,
    item_id BIGINT
) WITH (
    'connector.type'='elasticsearch',
    'connector.version'='7',
    'connector.hosts'='http://localhost:9200',
    'connector.index'='user_behavior_es',
    'connector.document-type'='user_behavior_es',
    'connector.enable-auth'='true',
    'connector.username'='zhisheng',
    'connector.password'='123456',
    'format.type'='json',
    'update-mode'='append',
    'connector.bulk-flush.max-actions'='10'
)

Issue Links

• duplicates: FLINK-11346 Could not enable basic authentication with elastic search connector
• duplicates: FLINK-17116 support UsernamePasswordCredentials for elasticsearch sink via SQL DDL
• duplicates: FLINK-18169 ES6 sql sink should allow users to configure connector properties for basic authentication
• is related to: FLINK-18361 Support username and password options for new Elasticsearch connector
• links to: GitHub Pull Request #11621
• links to: GitHub Pull Request #11822