Flume
  1. Flume
  2. FLUME-1319

File Channel optimize replay of logs when a checkpoint is present

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.

      1. FLUME-1319-1.patch
        3 kB
        Arvind Prabhakar

        Issue Links

          Activity

          Arvind Prabhakar created issue -
          Arvind Prabhakar made changes -
          Field Original Value New Value
          Attachment FLUME-1319-1.patch [ 12533424 ]
          Hide
          Arvind Prabhakar added a comment -

          Attached the first cut patch.

          Show
          Arvind Prabhakar added a comment - Attached the first cut patch.
          Arvind Prabhakar made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s v1.2.0 [ 12320243 ]
          Arvind Prabhakar made changes -
          Remote Link This issue links to "Review Reqest (Web Link)" [ 10216 ]
          Hide
          Mike Percy added a comment -

          Patch committed. Thanks Arvind!

          Show
          Mike Percy added a comment - Patch committed. Thanks Arvind!
          Mike Percy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          Integrated in flume-trunk #257 (See https://builds.apache.org/job/flume-trunk/257/)
          FLUME-1319. Log replay optimization.

          (Arvind Prabhakar via Mike Percy) (Revision 1353848)

          Result = UNSTABLE
          mpercy : http://svn.apache.org/viewvc/?view=rev&rev=1353848
          Files :

          • /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java
          • /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java
          Show
          Hudson added a comment - Integrated in flume-trunk #257 (See https://builds.apache.org/job/flume-trunk/257/ ) FLUME-1319 . Log replay optimization. (Arvind Prabhakar via Mike Percy) (Revision 1353848) Result = UNSTABLE mpercy : http://svn.apache.org/viewvc/?view=rev&rev=1353848 Files : /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          33m 44s 1 Arvind Prabhakar 26/Jun/12 03:40
          Patch Available Patch Available Resolved Resolved
          5h 11m 1 Mike Percy 26/Jun/12 08:52

            People

            • Assignee:
              Arvind Prabhakar
              Reporter:
              Arvind Prabhakar
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development