Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2501

Updating HttpClient lib version to ensure compat with Solr

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.5.0.1
    • Fix Version/s: None
    • Component/s: Sinks+Sources
    • Labels:

      Description

      Mismatch in httpclient and http core libs pulled by flume v/s the ones that come with Solr causes errors at runtime

      2014-10-13 19:52:32,042 (lifecycleSupervisor-1-1) [DEBUG - org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:106)] Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
      2014-10-13 19:52:32,225 (lifecycleSupervisor-1-1) [ERROR - org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:253)] Unable to start SinkRunner: { policy:org.apache.flume.sink.DefaultSinkProcessor@4752b854 counterGroup:{ name:null counters:{} } } - Exception follows.
      java.lang.NoSuchFieldError: DEF_CONTENT_CHARSET
      	at org.apache.http.impl.client.DefaultHttpClient.setDefaultHttpParams(DefaultHttpClient.java:175)
      	at org.apache.http.impl.client.DefaultHttpClient.createHttpParams(DefaultHttpClient.java:158)
      	at org.apache.http.impl.client.AbstractHttpClient.getParams(AbstractHttpClient.java:448)
      	at org.apache.solr.client.solrj.impl.HttpClientUtil.setFollowRedirects(HttpClientUtil.java:251)
      	at org.apache.solr.client.solrj.impl.HttpClientConfigurer.configure(HttpClientConfigurer.java:58)
      	at org.apache.solr.client.solrj.impl.HttpClientUtil.configureClient(HttpClientUtil.java:133)
      	at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:109)
      	at org.apache.solr.client.solrj.impl.HttpSolrServer.<init>(HttpSolrServer.java:161)
      	at org.apache.solr.client.solrj.impl.HttpSolrServer.<init>(HttpSolrServer.java:138)
      	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.<init>(ConcurrentUpdateSolrServer.java:122)
      	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.<init>(ConcurrentUpdateSolrServer.java:114)
      	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.<init>(ConcurrentUpdateSolrServer.java:104)
      	at org.kitesdk.morphline.solr.SafeConcurrentUpdateSolrServer.<init>(SafeConcurrentUpdateSolrServer.java:39)
      	at org.kitesdk.morphline.solr.SafeConcurrentUpdateSolrServer.<init>(SafeConcurrentUpdateSolrServer.java:35)
      	at org.kitesdk.morphline.solr.SolrLocator.getLoader(SolrLocator.java:116)
      	at org.kitesdk.morphline.solr.LoadSolrBuilder$LoadSolr.<init>(LoadSolrBuilder.java:70)
      	at org.kitesdk.morphline.solr.LoadSolrBuilder.build(LoadSolrBuilder.java:52)
      	at org.kitesdk.morphline.base.AbstractCommand.buildCommand(AbstractCommand.java:303)
      	at org.kitesdk.morphline.base.AbstractCommand.buildCommandChain(AbstractCommand.java:250)
      	at org.kitesdk.morphline.stdlib.Pipe.<init>(Pipe.java:46)
      	at org.kitesdk.morphline.stdlib.PipeBuilder.build(PipeBuilder.java:40)
      	at org.kitesdk.morphline.base.Compiler.compile(Compiler.java:126)
      	at org.kitesdk.morphline.base.Compiler.compile(Compiler.java:55)
      	at org.apache.flume.sink.solr.morphline.MorphlineHandlerImpl.configure(MorphlineHandlerImpl.java:101)
      	at org.apache.flume.sink.solr.morphline.MorphlineSink.start(MorphlineSink.java:97)
      	at org.apache.flume.sink.DefaultSinkProcessor.start(DefaultSinkProcessor.java:46)
      	at org.apache.flume.SinkRunner.start(SinkRunner.java:79)
      	at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      

        Attachments

        1. FLUME-2501.patch
          0.5 kB
          Roshan Naik
        2. FLUME-2501.v2.patch
          0.5 kB
          Roshan Naik

          Issue Links

            Activity

              People

              • Assignee:
                venkatnrangan Venkat Ranganathan
                Reporter:
                roshan_naik Roshan Naik
              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: