Tajo
  1. Tajo
  2. TAJO-292

Too many intermediate partition files

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.2-incubating
    • Fix Version/s: 0.8.0
    • Component/s: data shuffle
    • Labels:
      None

      Description

      Unlike the before, the number of partitions are being currently determined by the volume size and the number of distinct keys. It can cause unnecessary overheads. We need to improve the partition number determiner to consider the number of cluster nodes.

      1. TAJO-292_3.patch
        24 kB
        Jinho Kim
      2. TAJO-292_2.patch
        22 kB
        Jinho Kim
      3. TAJO-292.patch
        23 kB
        Jinho Kim

        Issue Links

          Activity

          Hyunsik Choi created issue -
          Jinho Kim made changes -
          Field Original Value New Value
          Assignee Hyunsik Choi [ hyunsik ] Jinho Kim [ jhkim ]
          Jinho Kim made changes -
          Attachment TAJO-292.patch [ 12616750 ]
          Jinho Kim made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 0.2-incubating [ 12324252 ]
          Hyunsik Choi made changes -
          Link This issue is related to TAJO-374 [ TAJO-374 ]
          Jinho Kim made changes -
          Link This issue relates to TAJO-268 [ TAJO-268 ]
          Jinho Kim made changes -
          Attachment TAJO-292_2.patch [ 12617113 ]
          Jinho Kim made changes -
          Attachment TAJO-292_3.patch [ 12617125 ]
          Jinho Kim made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              Jinho Kim
              Reporter:
              Hyunsik Choi
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development