[KYLIN-3680] Spark cubing failed with JDBC resource

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v2.4.0, v2.4.1, v2.5.0, v2.5.1
• Fix Version/s: v2.6.0
• Component/s: Spark Engine
• Assignee: Chao Long
• Reporter: Zhixiong Chen
• Created: 12/Nov/18 02:39
• Updated: 12/Jan/19 06:41
• Resolved: 14/Dec/18 09:34

Description

I find in JdbcHiveMRInput.java , the  system save flat table with TextFile.

However in SparkCubingByLayer.java, the system getFlatTableStorageFormat is SequenceFile .It read the flat table as SequenceFile and failed.

I workaround with add property "kylin.source.hive.flat-table-storage-format=TEXTFILE" in cube.

But I think maybe we could do it better.