[FLUME-1264] HDFEventSink throws NPE if event is generated without timestamp in header

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: Sinks+Sources
• Labels: noob
• Assignee: Mubarak Seyed
• Reporter: Mubarak Seyed
• Created: 09/Jun/12 00:53
• Updated: 28/May/14 03:30

Description

If timestamp is null then it may defaults to new Date().getTime()

long ts = Long.valueOf(headers.get("timestamp"));

2012-06-09 00:48:36,166 ERROR hdfs.HDFSEventSink: process failed
java.lang.NumberFormatException: null
	at java.lang.Long.parseLong(Long.java:375)
	at java.lang.Long.valueOf(Long.java:525)
	at org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:220)
	at org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:310)
	at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:366)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
	at java.lang.Thread.run(Thread.java:662)
2012-06-09 00:48:36,168 ERROR flume.SinkRunner: Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: java.lang.NumberFormatException: null
	at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:414)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
	at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.NumberFormatException: null
	at java.lang.Long.parseLong(Long.java:375)
	at java.lang.Long.valueOf(Long.java:525)
	at org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:220)
	at org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:310)
	at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:366)
	... 3 more

Issue Links

• is duplicated by: FLUME-2147 Missing headers cause events to become stuck in channel