Why Is Partition Quantity Limited?¶
Kafka manages messages by partition. If there are too many partitions, message creation, storage, and retrieval will be fragmented, affecting the performance and stability. If the total number of partitions of topics reaches the upper limit, you cannot create more topics.
The partition limit varies depending on the flavor, as shown in the following table.
Bandwidth | I/O Type | TPS (High-Throughput) | TPS (Synchronous Replication) | Maximum Partitions |
|---|---|---|---|---|
100 MB/s | High I/O | 100,000 | 60,000 | 300 |
Ultra-high I/O | 100,000 | 80,000 | 300 | |
300 MB/s | High I/O | 300,000 | 150,000 | 900 |
Ultra-high I/O | 300,000 | 200,000 | 900 | |
600 MB/s | Ultra-high I/O | 600,000 | 300,000 | 1800 |
1200 MB/s | Ultra-high I/O | 1,200,000 | 400,000 | 1800 |