[FLINK-31820] Support data source sub-database and sub-table

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Connectors / JDBC
• Labels: auto-deprioritized-major pull-request-available
• Assignee: Unassigned
• Reporter: xingyuan cheng
• Created: 17/Apr/23 09:04
• Updated: 22/Aug/23 22:35

Description

At present, apache/flink-connector-jdbc does not support sub-database and table sub-database. Now three commonly used databases Mysql, Postgres and Oracle support sub-database and sub-table

 

Taking oracle as an example, users only need to configure the following format to use

 

create table oracle_source (
    EMPLOYEE_ID BIGINT,
    START_DATE TIMESTAMP,
    END_DATE TIMESTAMP,
    JOB_ID VARCHAR,
    DEPARTMENT_ID VARCHAR
) with (
    type = 'oracle',    
    url = 'jdbc:oracle:thin:@//localhost:3306/order_([0-9]{1,}),jdbc:oracle:thin:@//localhost:3306/order_([0-9]{1,})',
   userName = 'userName',
    password = 'password',
    dbName = 'hr', 
    table-name = 'order_([0-9]{1,})',
    timeField = 'START_DATE',
    startTime = '2007-1-1 00:00:00'
); 

In the above code, the dbName attribute corresponds to the schema-name attribute in oracle or postgres, and the mysql database needs to manually specify the dbName

 

At the same time, I am also developing the CDAS whole database synchronization syntax for the company, and the data source supports sub-database and table as part of it. Add unit tests. For now, please keep this PR in draft status.

Issue Links

• links to: GitHub Pull Request #42