[TAJO-283] Add Table Partitioning

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0, 0.9.0
• Component/s: Catalog, Physical Operator, Planner/Optimizer
• Assignee: Hyunsik Choi
• Reporter: Hyunsik Choi
• Created: 25/Oct/13 04:39
• Updated: 15/Oct/15 04:44
• Resolved: 15/Oct/15 04:44

Description

Table partitioning gives many facilities to maintain large tables. First of all, it enables the data management system to prune many input data which are actually not necessary. In addition, it gives the system more optimization opportunities that exploit the physical layouts.

Basically, Tajo should follow the RDBMS-style partitioning system, including range, list, hash, and so on. In order to keep Hive compatibility, we need to add Hive partition type that does not exists in existing DBMS systems.

Sub-Tasks

• Add table partitioning entry to Catalog.: Resolved
• Add CREATE TABLE... BY PARTITION statement to parser: Resolved
• Implement physical operator to store in column-partitioned table.: Resolved
• Add Query Optimization Part for Column-Partitioned Tables: Resolved
• Add CREATE EXTERNAL TABLE... BY PARTITION statement to parser: Resolved
• Add shuffle phase for column-partitioned table store: Resolved
• CTAS statement should support partitioned table: Resolved