[HIVE-1603] support CSV text file format

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.7.0
• Assignee: Unassigned
• Reporter: Ning Zhang
• Created: 27/Aug/10 19:38
• Updated: 06/May/16 16:36
• Resolved: 06/May/16 16:35

Description

Comma Separated Values (CSV) text format are commonly used in exchanging relational data between heterogeneous systems. Currently Hive uses TextFile format when displaying query results. This could cause confusions when column values contain new lines or tabs. A CSVTextFile format could get around this problem. This will require a new CSVTextInputFormat, CSVTextOutputFormat, and CSVSerDe.

A proposed use case is like:

-- exporting a table to CSV files in a directory
hive> set hive.io.output.fileformat=CSVTextFile;
hive> insert overwrite local directory '/tmp/CSVrepos/' select * from S where ... ;

-- query result in CSV
hive -e 'set hive.io.output.fileformat=CSVTextFile; select * from T;' | sql_loader_to_other_systems

-- query CSV files directory from Hive
hive> create table T (...) stored as CSVTextFile;
hive> load data local inpath '/my/CSVfiles' into table T;
hive> select * from T where ...;

Issue Links

• duplicates: HIVE-7777 Add CSV Serde based on OpenCSV