Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1661

Sqoop2: Intermediate data format text null handling

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.99.4
    • Fix Version/s: 1.99.4
    • Component/s: sqoop2-framework
    • Labels:
      None

      Description

      Error:

      Error: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor run at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:99) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write to the data writer at org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeContent(SqoopMapper.java:148) at org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeArrayRecord(SqoopMapper.java:122) at org.apache.sqoop.connector.jdbc.GenericJdbcExtractor.extract(GenericJdbcExtractor.java:62) at org.apache.sqoop.connector.jdbc.GenericJdbcExtractor.extract(GenericJdbcExtractor.java:31) at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:94) ... 7 more Caused by: org.apache.sqoop.common.SqoopException: INTERMEDIATE_DATA_FORMAT_0002:An error has occurred while escaping a row. - null null 0 null at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.escapeStrings(CSVIntermediateDataFormat.java:332) at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.escapeArray(CSVIntermediateDataFormat.java:299) at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.setObjectData(CSVIntermediateDataFormat.java:243) at org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeContent(SqoopMapper.java:143) ... 11 more Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143
      

      It seems like both NULL strings aren't handled properly.

        Attachments

        1. SQOOP-1661.1.patch
          3 kB
          Abraham Elmahrek
        2. SQOOP-1661.0.patch
          3 kB
          Abraham Elmahrek

          Issue Links

            Activity

              People

              • Assignee:
                abec Abraham Elmahrek
                Reporter:
                abec Abraham Elmahrek
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: