Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2289

Tablet deletion should be throttled

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.7.0
    • Fix Version/s: 1.8.0
    • Component/s: tserver
    • Labels:
      None

      Description

      Currently if a large amount of data is deleted simultaneously, the master will not do any throttling of the DeleteTablet requests send to the tservers. The tservers will use up to the configured number of service threads to work on deleting tablets. The deletion can be relatively heavy-weight – lots of file system operations to hole-punch out the dead tablets, etc. This can have a negative impact on other concurrent workloads.

      It would be desirable to do some throttling either on the master or tserver side to avoid overwhelming disks and thread resources during heavy deletion.

        Attachments

          Activity

            People

            • Assignee:
              wdberkeley William Berkeley
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: