Flow: using a basic flow, spoolDir -> fileChannel -> HDFS
No extra parameters set in the .conf file
File size that i'm trying to transfer: 1.4GB
Situation: the agents starts fine, the file transfer starts fine, the file in source gets renamed to .COMPLETED, the complete file is not getting transfered to HDFS, no errors/exceptions are being thrown. I ran the same adhoc several times i found that out of the 1.4 gigs only ~169Mb is getting transfered. Seems weird !
Any suggestions? Any solutions? any hypotheses?