Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-11506 Improvements for large scale deletion
  3. HDDS-11633

Delete message body too large, causing SCM to fail writing raft log

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      OM uses KeyDeletingService to traverse the deletedtable data in rocksdb, packages the block information to be deleted, and sends it to SCM for recording. The SCM leader receives the record and records it in their rocksdb, and sends a draft request to other SCM follower nodes.

      When the data read from om's deletedtable is too large, for example, it has exceeded 5MB, and the upper limit of the draft log size for SCM is 5MB, it will cause writing the draft log for SCM to fail.

       

      Attachments

        Activity

          People

            Nicholas Niu GuoHao
            Nicholas Niu GuoHao
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: