[KUDU-3139] Add thread-safe KuduPartitioner::PartitionRow() method

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Fix Version/s: NA
• Component/s: client
• Labels: impala
• Assignee: Unassigned
• Reporter: Tim Armstrong
• Created: 02/Jun/20 17:57
• Updated: 05/Jun/20 16:24
• Resolved: 05/Jun/20 16:24

Description

We have a scenario in IMPALA-9782 where we'd like to have multiple threads use KuduPartitioner, but this currently requires instantiating many instances, which is somewhat expensive. It would be a good improvement if we could share the KuduPartitioner. This currently doesn't work because PartitionRow() internally uses a buffer that's a member of the object - https://github.com/cloudera/kudu/blob/master/src/kudu/client/partitioner-internal.cc#L40

I talked with aserbin on slack and he suggested that adding a new method that is not stateful would be a good way to solve this (I also considered cloning KuduPartitioner).

Issue Links

• is depended upon by: IMPALA-9782 KuduPartitionExpr is not thread-safe