Tajo
  1. Tajo
  2. TAJO-292

Too many intermediate partition files

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.2-incubating
    • Fix Version/s: 0.8.0
    • Component/s: data shuffle
    • Labels:
      None

      Description

      Unlike the before, the number of partitions are being currently determined by the volume size and the number of distinct keys. It can cause unnecessary overheads. We need to improve the partition number determiner to consider the number of cluster nodes.

      1. TAJO-292.patch
        23 kB
        Jinho Kim
      2. TAJO-292_2.patch
        22 kB
        Jinho Kim
      3. TAJO-292_3.patch
        24 kB
        Jinho Kim

        Issue Links

          Activity

            People

            • Assignee:
              Jinho Kim
              Reporter:
              Hyunsik Choi
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development