[FLUME-2836] Flume and Cassandra sink

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.6.0
• Fix Version/s: notrack
• Component/s: Sinks+Sources

Environment

Ubuntu.14.04,hadoop.2.2.0,flume.1.6.0,cassandra.2.1.11,

• Assignee: Unassigned
• Reporter: Veerendra Nath Jasthi
• Created: 04/Nov/15 09:29
• Updated: 04/Nov/15 14:33
• Resolved: 04/Nov/15 14:33

Description

This is My flume.conf file:

1. custom Cassandra sink
   cassandra_agent.sinks.sink3.type = com.veeru.flume.CustomCassandraSink
   cassandra_agent.sinks.sink3.channel = channel1

cassandra_agent.sources = source1 source2 source3
cassandra_agent.channels = channel1 channel2 channel3
cassandra_agent.sinks = sink1 sink2 sink3

cassandra_agent.sources.source1.type = exec
cassandra_agent.sources.source1.command = tail -F /home/hduser/input1.log
cassandra_agent.sources.source1.channels = channel1

cassandra_agent.channels.channel1.type = memory

cassandra_agent.sinks.sink1.type = avro
cassandra_agent.sinks.sink1.hostname = localhost
cassandra_agent.sinks.sink1.port = 9160
cassandra_agent.sinks.sink1.channel = channel1

cassandra_agent.sources.source2.type = exec
cassandra_agent.sources.source2.command = tail -F /home/hduser/input2.log
cassandra_agent.sources.source2.channels = channel2

cassandra_agent.channels.channel2.type = memory

cassandra_agent.sinks.sink2.type = avro
cassandra_agent.sinks.sink2.hostname = localhost
cassandra_agent.sinks.sink2.port = 9160
cassandra_agent.sinks.sink2.channel = channel2

cassandra_agent.sources.source3.type = avro
cassandra_agent.sources.source3.bind = localhost
cassandra_agent.sources.source3.port = 9160
cassandra_agent.sources.source3.channels = channel3

cassandra_agent.channels.channel3.type = memory
cassandra_agent.channels.channel3.capacity = 1000
cassandra_agent.channels.channel3.transactionCapacity = 100

1. custom Cassandra sink
   cassandra_agent.sinks.sink3.type = com.veeru.flume.CustomCassandraSink
   cassandra_agent.sinks.sink3.channel = channel3

----------------
Whenever I am running the agent I could see this error:

ERROR lifecycle.LifecycleSupervisor: Unable to start SinkRunner: { policy:org.apache.flume.sink.DefaultSinkProcessor@28c1b980 counterGroup:{ name:null counters:{} } } - Exception follows.
java.lang.IllegalArgumentException:

Could someone help me out on this ?