[KYLIN-3432] Merge segments from HBase snapshots

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Component/s: Job Engine
• Assignee: Unassigned
• Reporter: Shao Feng Shi
• Created: 27/Jun/18 10:59
• Updated: 02/Mar/20 14:53
• Resolved: 02/Mar/20 14:53

Description

HBase introduces the MultiTableSnapshotInputFormat since 1.2 ; Kylin can merge segments with this method, so that the cuboid files can be deleted.

 

1. HBASE-13356
2. Sample code: https://github.com/apache/hbase/blob/master/hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapred/MultiTableSnapshotInputFormat.java

Issue Links

• is related to: KYLIN-1007 Engine MR_V2 also generates cuboid files and merge from it