Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-12354

Ozone: Shuffle container list for datanode BlockDeletingService

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7240
    • datanode, ozone
    • None
    • Reviewed

    Description

      BlockDeletingService is a per-datanode container block deleting service takes in charge of the "real" deletion of ozone blocks. It spawns a worker thread per container and delete blocks/chunks from disk as background threads. The number of threads currently is throttled by ozone.block.deleting.container.limit.per.interval, but there is a potential problem. Containers are sorted so it always fetch same of containers, we need to fix this by creating an API in ContainerManagerImpl to get a shuffled list of containers.

      Attachments

        1. HDFS-12354-HDFS-7240.001.patch
          22 kB
          Yiqun Lin
        2. HDFS-12354-HDFS-7240.002.patch
          22 kB
          Yiqun Lin

        Activity

          People

            linyiqun Yiqun Lin
            cheersyang Weiwei Yang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: