[BAHIR-160] Allow 'low level' Redis commands for the Redis Flink Connector

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Flink-1.0
• Fix Version/s: Flink-1.2.0
• Component/s: Flink Streaming Connectors
• Assignee: Unassigned
• Reporter: David Maier
• Created: 23/Feb/18 16:25
• Updated: 06/Oct/22 15:45

Description

Hello,

would it be possible to allow the usage of more than the currently wrapped commands in the flink connector?

Background is that Redis is now supporting modules. Each module can have a specific set of own commands.

The connector seems to rely on Jedis. Jedis is allowing to execute any kind of command by providing the 'sendCommand(...)' method as part of the BinaryClient class. Here an example:

 

jedis.getClient().sendCommand(...)

 

Further details can be found here:  https://github.com/xetorthio/jedis/blob/master/src/main/java/redis/clients/jedis/BinaryClient.java .

 

It seems that the class RedisContainer (https://github.com/apache/bahir-flink/blob/master/flink-connector-redis/src/main/java/org/apache/flink/streaming/connectors/redis/common/container/RedisContainer.java) implements only a portion of the possible Redis commands. So it would be actually great to have 'sendCommand' as one of the wrapped methods in order to leverage specific Module functionality on the server side.

I didn't dig too deep into the command mapping part yet, but do you think this is a feasible?

Regards,

David Maier