Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2113

Flume: No errors thrown but flume fails to transfer the file completely

    XMLWordPrintableJSON

    Details

    • Type: Question
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      Flow: using a basic flow, spoolDir -> fileChannel -> HDFS

      No extra parameters set in the .conf file

      File size that i'm trying to transfer: 1.4GB

      Situation: the agents starts fine, the file transfer starts fine, the file in source gets renamed to .COMPLETED, the complete file is not getting transfered to HDFS, no errors/exceptions are being thrown. I ran the same adhoc several times i found that out of the 1.4 gigs only ~169Mb is getting transfered. Seems weird !

      Any suggestions? Any solutions? any hypotheses?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              kasavarun kasa v varun
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: