[FLUME-653] Can't get WAL to work on Windows. NULL pointer exception in ThriftEventAdaptor.set when using WAL configuration.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.9.3
• Fix Version/s: 0.9.5
• Component/s: Shell, Sinks+Sources
• Labels: WAL sink

Environment

Windows

• Assignee: Unassigned
• Reporter: Disabled imported user
• Created: 09/Jun/11 12:41
• Updated: 05/Nov/14 10:22
• Resolved: 05/Nov/14 10:22

Description

Can't get WAL to work on Windows. NULL pointer exception in ThriftEventAdaptor.set when using WAL configuration.

11/06/09 05:36:11 ERROR connector.DirectDriver: Driving src/sink failed! LazyOpenSource | LazyOpenDecorator because null
java.lang.NullPointerException
at com.cloudera.flume.handlers.thrift.ThriftEventAdaptor.set(ThriftEventAdaptor.java:183)
at com.cloudera.flume.handlers.rolling.RollSink.append(RollSink.java:172)
at com.cloudera.flume.agent.durability.NaiveFileWALDeco.append(NaiveFileWALDeco.java:138)
at com.cloudera.flume.agent.AgentSink.append(AgentSink.java:112)
at com.cloudera.flume.core.EventSinkDecorator.append(EventSinkDecorator.java:60)
at com.cloudera.flume.handlers.debug.LazyOpenDecorator.append(LazyOpenDecorator.java:75)
at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:93)

One agent, one collector configuration as follows. Agent is running on a Windows box (running 0.9.3) Collector on a Linux VM (running 0.9.3).

agent.et.local : rpcSource( 54001 ) | agentSink("collector.et.local",35853)
collector : collectorSource(35853) | collectorSink("/var/log/collected","collected")

Agent Config

<property>
<name>flume.collector.event.host</name>
<value>collector.et.local</value>
</property>

<property>
<name>flume.collector.port</name>
<value>35853</value>
</property>

Collector Config

<property>
<name>flume.collector.event.host</name>
<value>localhost</value>
</property>

<property>
<name>flume.collector.port</name>
<value>35853</value>
</property>

Full log attached.

I am able to get best effort sink on agent to work. i.e.

agentBESink("collector.et.local",35853)