Flume
  1. Flume
  2. FLUME-1922

HDFS Sink should optionally insert the timestamp at the sink

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.4.0
    • Component/s: None
    • Labels:
      None

      Description

      The HDFS Sink currently looks for the timestamp in the event headers. If some events are delayed then the events will end up in the old directory itself. We should allow the HDFS Sink to use the local timestamp to decide where the event goes.

      1. FLUME-1922-1.patch
        13 kB
        Hari Shreedharan
      2. FLUME-1922.patch
        13 kB
        Hari Shreedharan

        Issue Links

          Activity

          Mike Percy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s v1.4.0 [ 12323372 ]
          Resolution Fixed [ 1 ]
          Mike Percy made changes -
          Remote Link This issue links to "Review Board (Web Link)" [ 12045 ]
          Hari Shreedharan made changes -
          Attachment FLUME-1922-1.patch [ 12571079 ]
          Hari Shreedharan made changes -
          Description The HDFS Sink currently looks for the timestamp in the event headers. If some events are delayed then the events will end up in the old directory itself. We should allow the HDFS Sink to use the local timestamp to decide where the event goes.
          Hari Shreedharan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Hari Shreedharan [ hshreedharan ]
          Hari Shreedharan made changes -
          Field Original Value New Value
          Attachment FLUME-1922.patch [ 12570191 ]
          Hari Shreedharan created issue -

            People

            • Assignee:
              Hari Shreedharan
              Reporter:
              Hari Shreedharan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development