Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1319

File Channel optimize replay of logs when a checkpoint is present

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.

      1. FLUME-1319-1.patch
        3 kB
        Arvind Prabhakar

        Issue Links

          Activity

          Hide
          aprabhakar Arvind Prabhakar added a comment -

          Attached the first cut patch.

          Show
          aprabhakar Arvind Prabhakar added a comment - Attached the first cut patch.
          Hide
          mpercy Mike Percy added a comment -

          Patch committed. Thanks Arvind!

          Show
          mpercy Mike Percy added a comment - Patch committed. Thanks Arvind!
          Hide
          hudson Hudson added a comment -

          Integrated in flume-trunk #257 (See https://builds.apache.org/job/flume-trunk/257/)
          FLUME-1319. Log replay optimization.

          (Arvind Prabhakar via Mike Percy) (Revision 1353848)

          Result = UNSTABLE
          mpercy : http://svn.apache.org/viewvc/?view=rev&rev=1353848
          Files :

          • /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java
          • /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java
          Show
          hudson Hudson added a comment - Integrated in flume-trunk #257 (See https://builds.apache.org/job/flume-trunk/257/ ) FLUME-1319 . Log replay optimization. (Arvind Prabhakar via Mike Percy) (Revision 1353848) Result = UNSTABLE mpercy : http://svn.apache.org/viewvc/?view=rev&rev=1353848 Files : /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java

            People

            • Assignee:
              aprabhakar Arvind Prabhakar
              Reporter:
              aprabhakar Arvind Prabhakar
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development