[KYLIN-3070] Enable 'kylin.source.hive.flat-table-storage-format' for flat table storage format

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v2.2.0
• Fix Version/s: v2.3.0
• Component/s: Job Engine
• Labels: newbie
• Environment: HDP 2.5.6, Kylin 2.2.0
• Assignee: Vsevolod Ostapenko
• Reporter: Vsevolod Ostapenko
• Created: 29/Nov/17 22:36
• Updated: 07/Feb/19 09:25
• Resolved: 09/Dec/17 14:43

Description

Flat table storage format is currently hard-coded as SEQUENCEFILE in the core-job/src/main/java/org/apache/kylin/job/JoinedFlatTable.java
That prevents using Impala as a SQL engine while using beeline CLI (via custom JDBC URL), as Impala cannot write sequence files.
Adding a parameter to kylin.properties to override the default setting would address the issue.
Removing a hard-coded value for storage format might be good idea in and on itself.

Issue Links

• relates to: KYLIN-3806 test Apache Impala Hive compatibility on sample_cube table creation