[FLUME-2637] flume 1.5 doesnt update flume .tmp file in HDFS until roll

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 1.5.0
• Component/s: Sinks+Sources
• Assignee: Unassigned
• Reporter: sutanu das
• Created: 05/Mar/15 00:05
• Updated: 05/Mar/15 05:02

Description

When flume write to a HDFS Sync, it doesnt update the size (bytes0 and timstamp of the HDFS file (.tmp file), until the .tmp file is rolled

But when we get the file in ufs (via hadoop fs -get) , we see the correct size and timestemp

see below:

[hdfs@ham-dal-d001 ~]$ hdfs dfs -ls -R /prod/hadoop/smallsite/flume_ingest_hak_1/ClearPass_flume.1425066465833.tmp
rw-rr- 3 root hdfs 3598 2015-02-27 19:47 /prod/hadoop/smallsite/flume_ingest_hak_1/ClearPass_flume.1425066465833.tmp
[hdfs@ham-dal-d001 ~]$

hadoop fs -get /prod/hadoop/smallsite/flume_ingest_hak_1/ClearPass_flume.1425066465833.tmp /tmp/s.out