[KYLIN-1387] Streaming cubing doesn't generate cuboids files on HDFS, cause cube merge failure

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v1.4.0
• Fix Version/s: v1.4.0
• Component/s: NRT Streaming
• Assignee: Shao Feng Shi
• Reporter: Shao Feng Shi
• Created: 01/Feb/16 04:50
• Updated: 17/Mar/16 07:37
• Resolved: 02/Feb/16 09:42

Description

In an early version of Kylin streaming, the HBaseMROutput2.java will use HBase Scan API to do the merge. Later Yang refactored that into HBaseMROutput2Transition.java, while keep using the cuboids files on HDFS to do the merge. But the StreamingBatchBuilder didn't generate the cuboids, which causes the merge failed to run.

Solution: as a workaround, the StreamingBatchBuilder should leave cuboids files when building micro segments.