[BEAM-3246] BigtableIO should merge splits if they exceed 15K

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.5.0
• Component/s: io-java-gcp
• Assignee: Solomon Duskis
• Reporter: Solomon Duskis
• Created: 24/Nov/17 17:54
• Updated: 16/May/20 13:32
• Resolved: 25/Jun/18 21:15

Description

A customer hit a problem with a large number of splits. CloudBitableIO fixes that here https://github.com/GoogleCloudPlatform/cloud-bigtable-client/blob/master/bigtable-dataflow-parent/bigtable-hbase-beam/src/main/java/com/google/cloud/bigtable/beam/CloudBigtableIO.java#L241

BigtableIO should have similar logic.

Issue Links

• links to: GitHub Pull Request #4517