[FLINK-30359] Encountered NoClassDefFoundError when using flink-sql-connector-elasticsearch6

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.0, elasticsearch-3.0.0
• Fix Version/s: 1.16.1, elasticsearch-3.1.0, elasticsearch-3.0.1
• Component/s: Connectors / ElasticSearch
• Labels: pull-request-available
• Assignee: Weijie Guo
• Reporter: Weijie Guo
• Created: 10/Dec/22 17:31
• Updated: 28/Feb/23 16:52
• Resolved: 18/Jan/23 15:35

Description

When I use sql-client to submit job that sink data to elasticsearch, it seems that the `NoClassDefFoundError` arises as shown in the figure below. Note that the connector jar I used is flink-sql-connector-elasticsearch6-4.0-SNAPSHOT.jar, it is a uber jar compiled from flink-connector-elasticsearch repo's main branch.

Through some investigations, I found that in flink-sql-connector-elasticsearch6 module's pom.xml, we manually excluded the `com.carrotsearch: hppc` dependency, which is no problem for the 6.3.1 version of elasticsearch. However, FLINK-25189 bump this to 6.8.20, which does requires the dependence of hppc. Therefore, an `NoClassDefFoundError` occurred.

 

 

Issue Links

• relates to: FLINK-31263 Add smoke test for ElasticSearch connector
• links to: GitHub Pull Request #50