[FLUME-1668] Hdfs Sink File Rollover

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Cannot Reproduce
• Fix Version/s: 1.7.0
• Component/s: Sinks+Sources

Environment

Centos

• Assignee: Unassigned
• Reporter: Sachin Gupta
• Created: 26/Oct/12 01:09
• Updated: 25/Jun/16 11:53
• Resolved: 25/Jun/16 11:53

Description

With HDFS Sink with following config , files are rolling after every 510 bytes

Hadoop Environment : 1.0.0

Flume-Ng - 1.2.0

Config below

yum.sinks.ad-error-sink.type=hdfs
yum.sinks.ad-erorr-sink.hdfs.timeZone=UTC
yum.sinks.ad-error-sink.hdfs.path=hdfs://10.16.1.156:9000/home/data/flume-data/ad-error
yum.sinks.ad-error-sink.hdfs.filePrefix=aderror
yum.sinks.ad-error-sink.hdfs.fileType=DataStream
yum.sinks.ad-error-sink.hdfs.writeFormat=Text
yum.sinks.ad-error.sink.hdfs.rollInterval=0
yum.sinks.ad-error.sink.hdfs.rollSize=134217728
yum.sinks.ad-error.sink.hdfs.rollCount=0