Flume
  1. Flume
  2. FLUME-1319

File Channel optimize replay of logs when a checkpoint is present

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.

      1. FLUME-1319-1.patch
        3 kB
        Arvind Prabhakar

        Issue Links

          Activity

          Hide
          Arvind Prabhakar added a comment -

          Attached the first cut patch.

          Show
          Arvind Prabhakar added a comment - Attached the first cut patch.
          Hide
          Mike Percy added a comment -

          Patch committed. Thanks Arvind!

          Show
          Mike Percy added a comment - Patch committed. Thanks Arvind!
          Hide
          Hudson added a comment -

          Integrated in flume-trunk #257 (See https://builds.apache.org/job/flume-trunk/257/)
          FLUME-1319. Log replay optimization.

          (Arvind Prabhakar via Mike Percy) (Revision 1353848)

          Result = UNSTABLE
          mpercy : http://svn.apache.org/viewvc/?view=rev&rev=1353848
          Files :

          • /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java
          • /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java
          Show
          Hudson added a comment - Integrated in flume-trunk #257 (See https://builds.apache.org/job/flume-trunk/257/ ) FLUME-1319 . Log replay optimization. (Arvind Prabhakar via Mike Percy) (Revision 1353848) Result = UNSTABLE mpercy : http://svn.apache.org/viewvc/?view=rev&rev=1353848 Files : /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java

            People

            • Assignee:
              Arvind Prabhakar
              Reporter:
              Arvind Prabhakar
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development