[TAJO-935] (ColPartition)StoreTableExec should use per-file block size config for file creations.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Physical Operator
• Assignee: Unassigned
• Reporter: Hyunsik Choi
• Created: 11/Jul/14 10:52
• Updated: 03/May/16 20:16

Description

After TAJO-931 is supported, we can specify the output file size. If an user set some output file size larger than HDFS block, the output file will span multiple blocks. It causes remote HDFS access. To solve this problem, (ColPartition)StoreTableExec should use a given output file size as a per-file block size when it creates output files.

Issue Links

• is blocked by: TAJO-931 Output file can be punctuated depending on the file size.