Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1922

HDFS Sink should optionally insert the timestamp at the sink

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.0
    • Component/s: None
    • Labels:
      None

      Description

      The HDFS Sink currently looks for the timestamp in the event headers. If some events are delayed then the events will end up in the old directory itself. We should allow the HDFS Sink to use the local timestamp to decide where the event goes.

        Attachments

        1. FLUME-1922.patch
          13 kB
          Hari Shreedharan
        2. FLUME-1922-1.patch
          13 kB
          Hari Shreedharan

          Issue Links

            Activity

              People

              • Assignee:
                hshreedharan Hari Shreedharan
                Reporter:
                hshreedharan Hari Shreedharan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: