[KYLIN-252] Support more Hadoop file formats

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Labels: github-import
• Assignee: Shao Feng Shi
• Reporter: Luke Han
• Created: 09/Jan/15 15:33
• Updated: 09/Aug/17 04:47
• Resolved: 30/Sep/15 08:57

Description

So far kylin only supports text and sequence file as the file formats for source and intermediate hive tables; There are following limitations:

1. If user's hive table uses a different format, Kylin couldn't build the dictionary and parse;
2. If there is some dirty data in the table, Kylin may fail to split the columns;

To solve the above problem, Kylin need use a generic solution to support all file formats;

---------------- Imported from GitHub ----------------
Url: https://github.com/KylinOLAP/Kylin/issues/253
Created by: shaofengshi
Labels: enhancement,
Created at: Tue Dec 23 15:09:21 CST 2014
State: open