[FLINK-18702] Flink elasticsearch connector leaks threads and classloaders thereof

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.10.0, 1.10.1
• Fix Version/s: 1.10.2
• Component/s: Connectors / ElasticSearch
• Assignee: Jun Qin
• Reporter: Jun Qin
• Created: 24/Jul/20 09:33
• Updated: 07/Aug/20 18:51
• Resolved: 07/Aug/20 18:51

Description

Flink elasticsearch connector leaking threads and classloaders thereof.  This results in OOM Metaspace when ES sink fails and restarted many times. 

This issue is visible in Flink 1.10 but not in 1.11 because Flink 1.11 does not create new class loaders in case of recoveries (FLINK-16408)

 

Reproduction:

• Start a job with ES sink in a Flink 1.10 cluster, without starting the ES cluster.