Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-935

(ColPartition)StoreTableExec should use per-file block size config for file creations.

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Physical Operator
    • Labels:
      None

      Description

      After TAJO-931 is supported, we can specify the output file size. If an user set some output file size larger than HDFS block, the output file will span multiple blocks. It causes remote HDFS access. To solve this problem, (ColPartition)StoreTableExec should use a given output file size as a per-file block size when it creates output files.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                hyunsik Hyunsik Choi
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated: