Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-292

Too many intermediate partition files

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.2-incubating
    • Fix Version/s: 0.8.0
    • Component/s: Data Shuffle
    • Labels:
      None

      Description

      Unlike the before, the number of partitions are being currently determined by the volume size and the number of distinct keys. It can cause unnecessary overheads. We need to improve the partition number determiner to consider the number of cluster nodes.

        Attachments

        1. TAJO-292_2.patch
          22 kB
          Jinho Kim
        2. TAJO-292_3.patch
          24 kB
          Jinho Kim
        3. TAJO-292.patch
          23 kB
          Jinho Kim

          Issue Links

            Activity

              People

              • Assignee:
                jhkim Jinho Kim
                Reporter:
                hyunsik Hyunsik Choi
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: