Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-292

Too many intermediate partition files

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.2-incubating
    • 0.8.0
    • Data Shuffle
    • None

    Description

      Unlike the before, the number of partitions are being currently determined by the volume size and the number of distinct keys. It can cause unnecessary overheads. We need to improve the partition number determiner to consider the number of cluster nodes.

      Attachments

        1. TAJO-292_2.patch
          22 kB
          Jinho Kim
        2. TAJO-292_3.patch
          24 kB
          Jinho Kim
        3. TAJO-292.patch
          23 kB
          Jinho Kim

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. TAJO-374 Investigate more efficient intermediate shuffle methods

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. TAJO-268 Temporal files should be removed after query is finished

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              jhkim Jinho Kim
              hyunsik Hyunsik Choi
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: