Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2068

File Channel issue - recovering from BadCheckpoint exception on Windows

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.3.1
    • Fix Version/s: None
    • Component/s: Channel, File Channel, Windows
    • Labels:

      Description

      In EventQueueBackingStoreFileV3 constructor, if it detects that the checkpoint and meta files have differing logWriteOrderIds, it throws a BadCheckpointException. Controls goes back to the exception handler in Log.replay() which attempts to delete all the files in checkpoint directory and start fresh. The same file names are reused when starting fresh.

      Unfortunately this does not work on Windows since the deletion of the checkpoint file in the checkpointDir fails. The failure is due to the fact that the checkpoint file is memory mapped. Unless it is unmapped the deletion will not succeed... and unfortunately Java does not have unmap support. Windows does not permit deletion (or renaming) of files in use.

        Attachments

        1. FLUME-1.3.1-2068.patch
          15 kB
          Roshan Naik
        2. FLUME-2068v2.patch
          13 kB
          Roshan Naik

          Issue Links

            Activity

              People

              • Assignee:
                venkatnrangan Venkat Ranganathan
                Reporter:
                roshan_naik Roshan Naik
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: