[SQOOP-1678] Sqoop2: [HDFS Connector] Configurable null values

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.99.4
• Fix Version/s: 1.99.5
• Component/s: sqoop2-hdfs-connector
• Assignee: Abraham Elmahrek
• Reporter: Abraham Elmahrek
• Created: 05/Nov/14 08:50
• Updated: 11/Dec/14 05:45
• Resolved: 11/Dec/14 04:52

Description

Jobs should be able to define what the null values look like.

Simple table:

+-------+-------------+------+-----+---------+-------+
| Field | Type        | Null | Key | Default | Extra |
+-------+-------------+------+-----+---------+-------+
| id    | int(11)     | NO   | PRI | 0       |       |
| name  | varchar(35) | YES  |     | NULL    |       |
+-------+-------------+------+-----+---------+-------+

Content:

+----+------+
| id | name |
+----+------+
|  1 |      |
|  2 | test |
+----+------+
2 rows in set (0.00 sec)

Assuming the above blank "name" is null, then we should be able to tell the HDFS connector to choose different representations of NULL. Current default is NULL, but a blank value may be preferred instead:

1,NULL

or

1,

or

1,-

etc.

Issue Links

• links to: RB