[SQOOP-1342] Sqoop Import Job Hangs when the Netezza direct option is used !

• Type: Test
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.4.4
• Component/s: sqoop2-test
• Labels: test

Environment

sqoop-1.4.4.2.0.6.1-102.jar, nzjdbc3.jar

• Assignee: Unassigned
• Reporter: Shyam
• Created: 25/Jun/14 03:17
• Updated: 28/Feb/17 19:10

Description

Hi, The SQOOP Import job hangs when used with the Netezza -direct option. It runs fine without the "-direct" option.

Here is the SQOOP Job:
--------------------------------------------------------------------------------------------
/sqoop import --direct --connect "jdbc:netezza://netezza-1v:5480/DTSTTAPPL;schema=ADMIN;" --table PROCEDURE --username nzuser --P --target-dir /user/DTSTTAPPL/ --verbose -m 4
--------------------------------------------------------------------------------------------
The job hangs after saying that map 100% reduce 0%. I had to do a mapred job -kill.

In looking at the Ambari, it looks like it read only 4 records. Basically 1 per mapper.

In Looking at the YARN logs, I found the below error.

2014-06-24 22:31:26,064 ERROR [Thread-15] org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner: Unable to execute external table export
org.netezza.error.NzSQLException: ERROR: found delim ',' in a data field, specify escapeChar '\' option in the external table definition

There is only 1 Date Timestamp field in the table I'm trying to import and I did not see a ','. Am i supposed to create an external table in Netezza before hand. My assumption was using the "--direct" option will take care of creating the external table in Netezza and dropping it later.

Any help with this is appreciated.

• Venkat.