So the phenomena appears to be that mutations can return control to the ingestor before the minor compactions they cause have completed. Thus a single ingestor can cause multiple simultaneous compactions on the same tablet. If the table only has one tablet this cause the ingest process back up (see file 1ingestor_1table_1tablet.pdf). The solution is to presplit the tablet. The files 1ingestor_1table_2tablet.pdf and 1ingestor_1table_4tablet.pdf shows that these splits solves the problem. The file 2,3,4ingestor_1table_4tablet.pdf show the performance of three separate runs using 2, 3, and 4 ingestors into a table with 4 tablets.. Likewise, the file 10,r8,r10,r12ingestor_1table_12tablet.pdf shows four separate runs using 10 local, 8 remote, 10 remote, and 12 remote ingestors. In all cases, the splitting resolves the performance issue.
If there are no objections, this issue can be closed.