[BAHIR-309] flink-connector-redis add support for ZADD with GT/LT/INCR

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Flink-1.0
• Component/s: Flink Streaming Connectors
• Assignee: Unassigned
• Reporter: Anand Shah
• Created: 12/Jul/22 14:46
• Updated: 12/Jul/22 14:46

Description

Flink connector for Redis https://github.com/apache/bahir-flink/tree/master/flink-connector-redis already supports redis data structure SortedSet (ZADD)

 

Many open source users like to leverage additional command description on ZADD command like GT/LT and INCR for example to off load data replay/late arrival problem to the Redis.

 

Example 1: Leaderboard for maximum value

 

# Normal stream processing recording metric value = 40
ZADD my-leaderboard 40 Player_1 

 On late arrival/data correction of data for Player_1 we can do

 

 

# Replace metric value only if value is greater, otherwise NO OP.
ZADD my-leaderboard GT 55 Player_1 

 

 

Example 2: Leaderboard of total (Sum) of value

# Normal stream processing recording metric value
ZADD my-leaderboard 10 player_2

On late arrival of data, add late metrics to the existing sum metric

# Late arrival metric to be added in original metric
ZADD my-leaderboard INCR 5 player_2