[SQOOP-2003] Should not Schema be passed over the wire along with the IDF data?

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Fix Version/s: 2.0.0
• Assignee: Unassigned
• Reporter: Veena Basavaraj
• Created: 12/Jan/15 20:23
• Updated: 21/Oct/15 20:28
• Resolved: 21/Oct/15 20:28

Description

Should Schema be passed over the wire along with the IDF data?

Related to matching as well, since we create matcher again in the SqoopOutputFormatExecutor

    matcher = MatcherFactory.getMatcher(
        MRConfigurationUtils.getConnectorSchema(Direction.FROM, context.getConfiguration()),
        MRConfigurationUtils.getConnectorSchema(Direction.TO, context.getConfiguration()));
    toDataFormat = (IntermediateDataFormat<?>) ClassUtils.instantiate(context
        .getConfiguration().get(MRJobConstants.TO_INTERMEDIATE_DATA_FORMAT));
    // Using the TO schema since the SqoopDataWriter in the SqoopMapper encapsulates the toDataFormat
    toDataFormat.setSchema(matcher.getToSchema());

Issue Links

• depends upon: SQOOP-1975 GenericArray and GenericRecord to store array and maps in avor IDF