[SQOOP-1473] Sqoop import converts Microsoft SQL Server bit (1 or 0) data type to true/false

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.4.4
• Component/s: connectors/sqlserver
• Labels: binary bit boolean false import mappings override postgresql server sql sqoop true

Environment

Using Sqoop 1.4.4 in MapR 3.1

• Assignee: Unassigned
• Reporter: Michael England
• Created: 26/Aug/14 13:07
• Updated: 30/Oct/14 11:17

Description

When moving data between Microsoft SQL Server and Hadoop, a 'bit' data type in SQL Server (a 1 or a 0) is stored as 'true' or 'false' in the generated CSV. This means when an external Hive table is created over this data, the data type has to be set as boolean for this column. If a binary Hive data type is used, weird characters are shown as the underlying data is 'true' or 'false'.

This can cause issues if the data needs to be moved from Hadoop back into SQL Server as a data type conversion is needed. Therefore, it would be best to implement a 'boolean-true-string' and a 'boolean-false-string' option to override this like what has been done for PostgreSQL. N.B. I'm not using a hive-import and therefore can't override mappings.