Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2039

Sqoop2: KiteConnector To side need to convert JODA to AvroDate, BigDecimal to Avro Decimal type

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Labels:
      None

      Description

      as the description says KiteLoader needs to handle the date time/ decimal cases to Avro types before loading, since kite uses avro in memory

      NOTE: this is a non issue if we switch to AVRO IDF>

          DataReader reader = context.getDataReader();
          Object[] array;
          boolean success = false;
      
          try {
            while ((array = reader.readArrayRecord()) != null) {
              executor.writeRecord(array);
              rowsWritten++;
            }
            LOG.info(rowsWritten + " data record(s) have been written into dataset.");
            success = true;
          } finally {
            executor.closeWriter();
      
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                stanleyxu2005 Qian Xu
                Reporter:
                vybs Veena Basavaraj
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: