Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5783

flink-connector-kinesis java.lang.NoClassDefFoundError: org/apache/http/conn/ssl/SSLSocketFactory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.1.3
    • None
    • Connectors / Kinesis
    • None

    Description

      I got the error below while running flink consumer application the first time using kinesis connector. I was able to fix it by modifying the flink-connector-kinesis pom file to use the latest Kinesis and AWS SDK versions then rebuild the jar.

      Updated pom:

      <artifactId>flink-connector-kinesis_2.11</artifactId>
      <name>flink-connector-kinesis</name>
      <properties>
      <aws.sdk.version>1.11.86</aws.sdk.version>
      <aws.kinesis-kcl.version>1.7.3</aws.kinesis-kcl.version>
      <aws.kinesis-kpl.version>0.12.3</aws.kinesis-kpl.version>
      </properties>

      Errror:

      Exception in thread "main" org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
      at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$8.apply$mcV$sp(JobManager.scala:822)
      at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$8.apply(JobManager.scala:768)
      at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$8.apply(JobManager.scala:768)
      at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
      at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
      at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
      at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401)
      at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
      at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
      at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
      at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
      Caused by: java.lang.NoClassDefFoundError: org/apache/http/conn/ssl/SSLSocketFactory
      at org.apache.flink.kinesis.shaded.com.amazonaws.AmazonWebServiceClient.<init>(AmazonWebServiceClient.java:136)
      at org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.<init>(AmazonKinesisClient.java:221)
      at org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesis.AmazonKinesisClient.<init>(AmazonKinesisClient.java:197)
      at org.apache.flink.streaming.connectors.kinesis.util.AWSUtil.createKinesisClient(AWSUtil.java:56)
      at org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.<init>(KinesisProxy.java:124)
      at org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.create(KinesisProxy.java:182)
      at org.apache.flink.streaming.connectors.kinesis.internals.KinesisDataFetcher.<init>(KinesisDataFetcher.java:188)
      at org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.run(FlinkKinesisConsumer.java:198)
      at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:80)
      at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:53)
      at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:56)
      at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:266)
      at org.apache.flink.runtime.taskmanager.Task.run(Task.java:585)
      at java.lang.Thread.run(Thread.java:745)

      Attachments

        Issue Links

          Activity

            People

              dannycranmer Danny Cranmer
              zachahuy Huy Huynh
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: