Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2035

Sqoop2: KiteConnector From side need to send BigDecimal for decimal type and JODA for date type in Object array

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Labels:
      None

      Description

      At this point, we do not see the Kite Connector sending BigDecimal for objects that are Sqoop Decimal type, as we prescribe JODA for date objects, we need BigDecimal for decimal objects.

      code to be fixed

        @Override
        public void extract(ExtractorContext context, LinkConfiguration linkConfig,
            FromJobConfiguration fromJobConfig, KiteDatasetPartition partition) {
          String uri = partition.getUri();
          LOG.info("Loading data from " + uri);
      
          KiteDatasetExecutor executor = getExecutor(uri);
          DataWriter writer = context.getDataWriter();
          Object[] array;
          rowsRead = 0L;
      
          try {
            while ((array = executor.readRecord()) != null) {
              // TODO: SQOOP-1616 will cover more column data types. Use schema and do data type conversion (e.g. datatime).
              writer.writeArrayRecord(array);
              rowsRead++;
            }
          } finally {
            executor.closeReader();
          }
        }
      
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                stanleyxu2005 Qian Xu
                Reporter:
                vybs Veena Basavaraj
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: