Major Description
We have been seeing very slow processing speed when running a Samza container that consumes from 1000s of partitions. We don't see a corresponding slow speed when running the same code, but with fewer input partitions (say 8-24).
The messages per second seems to drop off as more partitions are added to the Samza container. One Samza job has ~2500 partitions, and is seeing only 6000 messages/sec. The same code running with ~9 partitions is seeing 30,000 messages/sec.
