Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2039

Sqoop2: KiteConnector To side need to convert JODA to AvroDate, BigDecimal to Avro Decimal type

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • 2.0.0
    • None
    • None

    Description

      as the description says KiteLoader needs to handle the date time/ decimal cases to Avro types before loading, since kite uses avro in memory

      NOTE: this is a non issue if we switch to AVRO IDF>

          DataReader reader = context.getDataReader();
          Object[] array;
          boolean success = false;
      
          try {
            while ((array = reader.readArrayRecord()) != null) {
              executor.writeRecord(array);
              rowsWritten++;
            }
            LOG.info(rowsWritten + " data record(s) have been written into dataset.");
            success = true;
          } finally {
            executor.closeWriter();
      
      

      Attachments

        Issue Links

          Activity

            People

              stanleyxu2005 Qian Xu
              vybs Veena Basavaraj
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: