[DERBY-4962] Create a table function which efficiently migrates data out of foreign databases and which can be used for ongoing data integration

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 10.9.1.0
• Component/s: Tools
• Assignee: Richard N. Hillegas
• Reporter: Richard N. Hillegas
• Created: 09/Jan/11 16:31
• Updated: 09/Sep/14 18:16
• Resolved: 17/Aug/11 20:00

Description

DDLUtils and other tools are good at copying the shape of foreign schemas into Derby. It would be good to have a tool which efficiently bulk-copies the foreign data into Derby. This would be faster than having to dump the foreign data into flat files and then import those files into Derby. In addition, many data integration applications need to siphon new data out of foreign database on an ongoing basis. A tool based around a RestrictedVTI would be able to push the column projection and WHERE clause into the foreign database in order to speed up the siphoning. I will attach a Restricted VTI which can be used for the following tasks:

1) Initial bulk-loading of Derby from a foreign database.

2) Efficient on-going data integration.

Issue Links

• is related to: DERBY-6732 Enhance the foreignViews optional tool so that it can just create views on a single foreign schema
• is related to: DERBY-6022 Add a system procedure for (un)registering optional packages of Derby tools.