Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-1049

Remove the parallel degree limit up to the maximum cluster capacity

    XMLWordPrintableJSON

Details

    Description

      The maximum parallel degree had been limited by the number of cluster node capacity. This was because the old hash shuffle approach created too many small files depending on the number of parallel degree of a stage.

      But, TAJO-992 solved this problem. We don't need to use this limit anymore. This patch removes the limit.

      I think that this patch requires cluster test and it is hard to verify this patch in unit tests.

      Attachments

        1. TAJO-1049.patch
          1 kB
          Hyunsik Choi
        2. TAJO-1049_3.patch
          2 kB
          Hyunsik Choi
        3. TAJO-1049_2.patch
          2 kB
          Hyunsik Choi

        Activity

          People

            hyunsik Hyunsik Choi
            hyunsik Hyunsik Choi
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: