Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-17372

Implement DeltaFilePageStore

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-beta1
    • None

    Description

      For the new checkpoint, we need to implement DeltaFilePageStore.

      Will consist of:

      • File header, similar to FilePageStore, but in addition it will store a sorted list of pageIdx in which it will be stored;
      • Pages themselves, sorted by pageIdx.

      Some implementation notes

      • Format of the file name for the DeltaFilePageStore is part-%d-delta-%d.bin for example part-1-delta-3.bin where the first digit is the partition identifier, and the second is the serial number of the delta file for this partition;
      • Before creating part-1-delta-3.bin, a temporary file part-1-delta-3.bin.tmp will be created at the checkpoint first, then filled, then renamed to part-1-delta-3.bin;
      • In each delta file we will store the org.apache.ignite.internal.storage.pagememory.io.PartitionMetaIo, which will be the first page in this file, and it will be special.

      Attachments

        Issue Links

          Activity

            People

              ktkalenko@gridgain.com Kirill Tkalenko
              ktkalenko@gridgain.com Kirill Tkalenko
              Ivan Bessonov Ivan Bessonov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 7h 20m
                  7h 20m