[SPARK-29611] Sort Kafka metadata by the number of messages

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.3.0, 2.4.4, 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Web UI
• Assignee: Deng Ziming
• Reporter: Deng Ziming
• Created: 26/Oct/19 09:21
• Updated: 02/Nov/19 05:50
• Resolved: 02/Nov/19 05:48

Description

we are suffering from data skewness from Kafka and need to analyze it by UI.

As the image shows, the UI of the streaming is confused, it's better to improve it by adding a count metric of each Kafka partition and sorting by count

Issue Links

• links to: GitHub Pull Request #26266