Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
1.6.0
-
flume 1.6.0
hbase 1.2.0
hadoop 2.7.2
Description
i want to use flume sink save data to hbase
version: flume 1.6.0 + hbase 1.2.0 + hadoop 2.7.2
27 Apr 2016 16:52:20,481 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.si
nk.hbase.HBaseSink.process:351) - Failed to commit transaction.Transaction rolled back.
java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.Put.setWriteToWAL(Z)V
at org.apache.flume.sink.hbase.HBaseSink$3.run(HBaseSink.java:377)
at org.apache.flume.sink.hbase.HBaseSink$3.run(HBaseSink.java:372)
at org.apache.flume.auth.SimpleAuthenticator.execute(SimpleAuthenticator.java:50)
at org.apache.flume.sink.hbase.HBaseSink.putEventsAndCommit(HBaseSink.java:372)
at org.apache.flume.sink.hbase.HBaseSink.process(HBaseSink.java:342)
at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:745)
how shall i do
flume.conf
#HKAgent.sinks.HKAgentSink1.type = hbase
HKAgent.sinks.HKAgentSink1.type=org.apache.flume.sink.hbase.HBaseSink
HKAgent.sinks.HKAgentSink1.table = message
HKAgent.sinks.HKAgentSink1.columnFamily = log
#HKAgent.sinks.HKAgentSink1.column=ml1
#HKAgent.sinks.HKAgentSink1.serializer=org.apache.flume.sink.hbase.SimpleHbaseEventSerializer
#HKAgent.sinks.HKAgentSink1.serializer=org.apache.flume.sink.hbase.RegexHbaseEventSerializer
#HKAgent.sinks.HKAgentSink1.serializer=org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer
#HKAgent.sinks.HKAgentSink1.zookeeperQuorum=h10:2181
#HKAgent.sinks.HKAgentSink1.znodeParent=/hbase
HKAgent.sinks.HKAgentSink1.channel=HKAgentCHl
i try all of the selectd items,but it seems to useless~~