[FLUME-2501] Updating HttpClient lib version to ensure compat with Solr

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.5.0.1
• Component/s: Sinks+Sources
• Labels: dependency
• Assignee: Venkat Ranganathan
• Reporter: Roshan Naik
• Created: 13/Oct/14 21:13
• Updated: 19/Dec/17 23:27

Description

Mismatch in httpclient and http core libs pulled by flume v/s the ones that come with Solr causes errors at runtime

2014-10-13 19:52:32,042 (lifecycleSupervisor-1-1) [DEBUG - org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:106)] Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
2014-10-13 19:52:32,225 (lifecycleSupervisor-1-1) [ERROR - org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:253)] Unable to start SinkRunner: { policy:org.apache.flume.sink.DefaultSinkProcessor@4752b854 counterGroup:{ name:null counters:{} } } - Exception follows.
java.lang.NoSuchFieldError: DEF_CONTENT_CHARSET
	at org.apache.http.impl.client.DefaultHttpClient.setDefaultHttpParams(DefaultHttpClient.java:175)
	at org.apache.http.impl.client.DefaultHttpClient.createHttpParams(DefaultHttpClient.java:158)
	at org.apache.http.impl.client.AbstractHttpClient.getParams(AbstractHttpClient.java:448)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.setFollowRedirects(HttpClientUtil.java:251)
	at org.apache.solr.client.solrj.impl.HttpClientConfigurer.configure(HttpClientConfigurer.java:58)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.configureClient(HttpClientUtil.java:133)
	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:109)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.<init>(HttpSolrServer.java:161)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.<init>(HttpSolrServer.java:138)
	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.<init>(ConcurrentUpdateSolrServer.java:122)
	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.<init>(ConcurrentUpdateSolrServer.java:114)
	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.<init>(ConcurrentUpdateSolrServer.java:104)
	at org.kitesdk.morphline.solr.SafeConcurrentUpdateSolrServer.<init>(SafeConcurrentUpdateSolrServer.java:39)
	at org.kitesdk.morphline.solr.SafeConcurrentUpdateSolrServer.<init>(SafeConcurrentUpdateSolrServer.java:35)
	at org.kitesdk.morphline.solr.SolrLocator.getLoader(SolrLocator.java:116)
	at org.kitesdk.morphline.solr.LoadSolrBuilder$LoadSolr.<init>(LoadSolrBuilder.java:70)
	at org.kitesdk.morphline.solr.LoadSolrBuilder.build(LoadSolrBuilder.java:52)
	at org.kitesdk.morphline.base.AbstractCommand.buildCommand(AbstractCommand.java:303)
	at org.kitesdk.morphline.base.AbstractCommand.buildCommandChain(AbstractCommand.java:250)
	at org.kitesdk.morphline.stdlib.Pipe.<init>(Pipe.java:46)
	at org.kitesdk.morphline.stdlib.PipeBuilder.build(PipeBuilder.java:40)
	at org.kitesdk.morphline.base.Compiler.compile(Compiler.java:126)
	at org.kitesdk.morphline.base.Compiler.compile(Compiler.java:55)
	at org.apache.flume.sink.solr.morphline.MorphlineHandlerImpl.configure(MorphlineHandlerImpl.java:101)
	at org.apache.flume.sink.solr.morphline.MorphlineSink.start(MorphlineSink.java:97)
	at org.apache.flume.sink.DefaultSinkProcessor.start(DefaultSinkProcessor.java:46)
	at org.apache.flume.SinkRunner.start(SinkRunner.java:79)
	at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

Issue Links

• is related to: FLUME-3114 Upgrade commons-httpclient library dependency