[ARROW-4144] [Java] Arrow-to-JDBC

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Java
• External issue URL: https://github.com/apache/arrow/issues/20730
• Assignee: Unassigned
• Reporter: Michael Pigott
• Created: 01/Jan/19 23:52
• Updated: 11/Jan/23 07:32

Description

ARROW-1780 reads a query from a JDBC data source and converts the ResultSet to an Arrow VectorSchemaRoot.  However, there is no built-in adapter for writing an Arrow VectorSchemaRoot back to the database.

ARROW-3966 adds JDBC field metadata:

• The Catalog Name
• The Table Name
• The Field Name
• The Field Type

We can use this information to ask for the field information from the database via the DatabaseMetaData object.  We can then create INSERT or UPDATE statements based on the list of primary keys in the table:

• If the value in the VectorSchemaRoot corresponding to the primary key is NULL, insert that record into the database.
• If the value in the VectorSchemaRoot corresponding to the primary key is not NULL, update the existing record in the database.

We can also perform the same data conversion in reverse based on the field types queried from the database.