Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7362

enable kafka broker to remove orphan partitions automatically

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: core, log
    • Labels:
      None

      Description

      When partition reassignment removes topic partitions from a offline broker, those removed partitions become orphan partitions to the broker. When the offline broker comes back online, it is not able to clean up both data and folders that belong to orphan partitions.  Log manager will scan all all dirs during startup, but the time based retention policy on a topic partition will not be kicked out until the broker is either a follower or a leader of the partition.  In addition, we do not have logic to delete folders that belong to orphan partition today.

      Open this ticket to provide a mechanism (when enabled) to safely remove orphan partitions automatically.

        Attachments

          Activity

            People

            • Assignee:
              xiongqiwu xiongqi wu
              Reporter:
              xiongqiwu xiongqi wu
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: