[TAJO-504] when inserting to a column partitioned table, if a queryunit attempt fails, an AlreadyExistsStorageException will throw

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 0.8.0
• Component/s: distributed query plan
• Assignee: Unassigned
• Reporter: Min Zhou
• Created: 14/Jan/14 23:44
• Updated: 08/Feb/14 14:12
• Resolved: 08/Feb/14 14:06

Description

I came across such exception these days.

ColumnPartitionedTableStoreExec creates hdfs directories based on partition values. For example is one of the partitions is 'col1=2', a directory named 'col1=2' will be created. If query unit attempt fails, that directory still exist. After that TajoQueryMaster start another query unit attempt to reprocessing the logic in ColumnPartitionedTableStoreExec. This physical executor try to create 'col1=2' again, but before creating, it found the target directory already exist, it will throw an AlreadyExistsStorageException. And eventually, the query fails.

Issue Links

• relates to: TAJO-591 Implement Output Committer for commiting final output files