Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-11506 Improvements for large scale deletion
  3. HDDS-11658

Skip known tombstones when scanning rocksdb deletedtable in KeyDeletingService

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      KeyDeletingService, iterate several records from scratch each time, send deletion requests, and then delete these records.

      If each iteration starts from scratch, Rocksdb will also include the recently deleted tombstone data in the scan.

      The optimization is to optimize the iteration strategy, record breakpoints for each iteration, skip known tombstones, and reset breakpoints if errors occur during the iteration or if the endpoint is reached.

      Attachments

        Issue Links

          Activity

            People

              Nicholas Niu GuoHao
              Nicholas Niu GuoHao
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: