[KUDU-1235] Add Get API

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: client, perf, tablet, tserver
• Labels: performance roadmap-candidate
• Assignee: Unassigned
• Reporter: Binglin Chang
• Created: 28/Oct/15 13:06
• Updated: 13/Jan/21 16:16

Description

Get API is more user friendly and efficient if use just want primary key lookup.

I setup a cluster and test get/scan single row using ycsb, initial test shows better performance for get.

kudu_workload:

recordcount=1000000
operationcount=1000000
workload=com.yahoo.ycsb.workloads.CoreWorkload

readallfields=false

readproportion=1
updateproportion=0
scanproportion=0
insertproportion=0

requestdistribution=uniform
use_get_api=false

load:
./bin/ycsb load kudu -P workloads/kudu_workload -p sync_ops=false -p pre_split_num_tablets=1 -p table_name=ycsb_wiki_example -p masterQuorum='c3-kudu-tst-st01.bj:32600' -threads 100

read test:
./bin/ycsb run kudu -P workloads/kudu_workload -p masterQuorum='c3-kudu-tst-st01.bj:32600' -threads 100

Get API:
[OVERALL], RunTime(ms), 21304.0
[OVERALL], Throughput(ops/sec), 46939.54187007135
[CLEANUP], Operations, 100.0
[CLEANUP], AverageLatency(us), 423.57
[CLEANUP], MinLatency(us), 24.0
[CLEANUP], MaxLatency(us), 19327.0
[CLEANUP], 95thPercentileLatency(us), 52.0
[CLEANUP], 99thPercentileLatency(us), 18815.0
[READ], Operations, 1000000.0
[READ], AverageLatency(us), 2065.185152
[READ], MinLatency(us), 134.0
[READ], MaxLatency(us), 92159.0
[READ], 95thPercentileLatency(us), 2391.0
[READ], 99thPercentileLatency(us), 6359.0
[READ], Return=0, 1000000

Scan API:
[OVERALL], RunTime(ms), 38259.0
[OVERALL], Throughput(ops/sec), 26137.6408165399
[CLEANUP], Operations, 100.0
[CLEANUP], AverageLatency(us), 47.32
[CLEANUP], MinLatency(us), 16.0
[CLEANUP], MaxLatency(us), 1837.0
[CLEANUP], 95thPercentileLatency(us), 41.0
[CLEANUP], 99thPercentileLatency(us), 158.0
[READ], Operations, 1000000.0
[READ], AverageLatency(us), 3595.825249
[READ], MinLatency(us), 139.0
[READ], MaxLatency(us), 3139583.0
[READ], 95thPercentileLatency(us), 3775.0
[READ], 99thPercentileLatency(us), 7659.0
[READ], Return=0, 1000000

Issue Links

• duplicates: KUDU-1018 Add method to get data from a single row