[SQOOP-2035] Sqoop2: KiteConnector From side need to send BigDecimal for decimal type and JODA for date type in Object array

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 2.0.0
• Assignee: Qian Xu
• Reporter: Veena Basavaraj
• Created: 22/Jan/15 19:08
• Updated: 26/Mar/15 07:53

Description

At this point, we do not see the Kite Connector sending BigDecimal for objects that are Sqoop Decimal type, as we prescribe JODA for date objects, we need BigDecimal for decimal objects.

code to be fixed

  @Override
  public void extract(ExtractorContext context, LinkConfiguration linkConfig,
      FromJobConfiguration fromJobConfig, KiteDatasetPartition partition) {
    String uri = partition.getUri();
    LOG.info("Loading data from " + uri);

    KiteDatasetExecutor executor = getExecutor(uri);
    DataWriter writer = context.getDataWriter();
    Object[] array;
    rowsRead = 0L;

    try {
      while ((array = executor.readRecord()) != null) {
        // TODO: SQOOP-1616 will cover more column data types. Use schema and do data type conversion (e.g. datatime).
        writer.writeArrayRecord(array);
        rowsRead++;
      }
    } finally {
      executor.closeReader();
    }
  }

Issue Links

• is a clone of: SQOOP-2027 Sqoop2: SqoopIDFUtils handling of decimal need to be fixed
• is blocked by: SQOOP-2189 Sqoop2: Failed to export date column
• is cloned by: SQOOP-2037 Sqoop2: HDFSConnector From side need to send BigDecimal for decimal type and JODA for date type in Object array
• is cloned by: SQOOP-2039 Sqoop2: KiteConnector To side need to convert JODA to AvroDate, BigDecimal to Avro Decimal type
• is cloned by: SQOOP-2036 Sqoop2: JDBC Connector need to send BigDecimal for decimal type in Object array