Details
-
Bug
-
Status: Open
-
Critical
-
Resolution: Unresolved
-
1.5.0
-
None
-
None
Description
When flume write to a HDFS Sync, it doesnt update the size (bytes0 and timstamp of the HDFS file (.tmp file), until the .tmp file is rolled
But when we get the file in ufs (via hadoop fs -get) , we see the correct size and timestemp
see below:
[hdfs@ham-dal-d001 ~]$ hdfs dfs -ls -R /prod/hadoop/smallsite/flume_ingest_hak_1/ClearPass_flume.1425066465833.tmp
rw-rr- 3 root hdfs 3598 2015-02-27 19:47 /prod/hadoop/smallsite/flume_ingest_hak_1/ClearPass_flume.1425066465833.tmp
[hdfs@ham-dal-d001 ~]$
hadoop fs -get /prod/hadoop/smallsite/flume_ingest_hak_1/ClearPass_flume.1425066465833.tmp /tmp/s.out