[SQOOP-1869] Sqoop2: Expand schema matching to support two schemaless connectors

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.99.5
• Assignee: Gwen Shapira
• Reporter: Gwen Shapira
• Created: 09/Dec/14 17:16
• Updated: 18/Dec/14 21:55
• Resolved: 18/Dec/14 21:34

Description

Currently the schema matches errors out if both FROM and TO connectors are empty. This prevents us from supporting HDFS->Kafka.

I suggest to change the code to support the following:
1. Empty schema will contain a single byte[] field with whatever the connector writes into it.
2. As happens now, one connector is null and the other has a schema, the schema that exists will be used to parse the data.
3. If we have two empty schemas, the TO connector will get a byte[] and presumably know what to do with it.

Issue Links

• duplicates: SQOOP-1818 Sqoop2: Allow transfer between 2 schema less data sources