Flume
  1. Flume
  2. FLUME-1763

FileChannel Checkpoints should not be done without free space

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.3.0
    • Fix Version/s: v1.3.1
    • Component/s: Channel
    • Labels:
      None

      Description

      We should not do a checkpoint if we do't have sufficient free space. The same approach as FLUME-1609 can be taken.

      1. FLUME-1763-4.patch
        14 kB
        Brock Noland
      2. FLUME-1763-3.patch
        14 kB
        Brock Noland
      3. FLUME-1763-2.patch
        14 kB
        Brock Noland
      4. FLUME-1763-1.patch
        14 kB
        Brock Noland

        Issue Links

          Activity

          Hide
          Brock Noland added a comment -

          We should also:

          1) Make that number configurable.
          2) Increase the default to 100MB

          Show
          Brock Noland added a comment - We should also: 1) Make that number configurable. 2) Increase the default to 100MB
          Hide
          Brock Noland added a comment -

          Note that although the checkpoint file itself is pre-allocated, the meta data file is not.

          Show
          Brock Noland added a comment - Note that although the checkpoint file itself is pre-allocated, the meta data file is not.
          Hide
          Brock Noland added a comment -

          Patch attached

          Show
          Brock Noland added a comment - Patch attached
          Hide
          Brock Noland added a comment -

          Latest patch attached.

          Show
          Brock Noland added a comment - Latest patch attached.
          Hide
          Brock Noland added a comment -

          LAtest

          Show
          Brock Noland added a comment - LAtest
          Hide
          Hari Shreedharan added a comment -

          +1.

          Show
          Hari Shreedharan added a comment - +1.
          Hide
          Hari Shreedharan added a comment -

          Patch committed, rev: 806a7b6ace9398de2645f073acc72de19913bfab. Thanks Brock!

          Show
          Hari Shreedharan added a comment - Patch committed, rev: 806a7b6ace9398de2645f073acc72de19913bfab. Thanks Brock!
          Hide
          Hudson added a comment -

          Integrated in flume-trunk #339 (See https://builds.apache.org/job/flume-trunk/339/)
          FLUME-1763. FileChannel checkpoints should not be done without free space (Revision 806a7b6ace9398de2645f073acc72de19913bfab)

          Result = SUCCESS
          hshreedharan : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=806a7b6ace9398de2645f073acc72de19913bfab
          Files :

          • flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FileChannelConfiguration.java
          • flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java
          • flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FileChannel.java
          • flume-ng-doc/sphinx/FlumeUserGuide.rst
          • flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestLog.java
          Show
          Hudson added a comment - Integrated in flume-trunk #339 (See https://builds.apache.org/job/flume-trunk/339/ ) FLUME-1763 . FileChannel checkpoints should not be done without free space (Revision 806a7b6ace9398de2645f073acc72de19913bfab) Result = SUCCESS hshreedharan : http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=806a7b6ace9398de2645f073acc72de19913bfab Files : flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FileChannelConfiguration.java flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FileChannel.java flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestLog.java

            People

            • Assignee:
              Brock Noland
              Reporter:
              Brock Noland
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development