Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-665

sort buffer size must be dealt as long type values.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0, 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      sort buffer size (tajo.executor.external-sort.buffer-mb in TajoConf) is used to determine in-memory buffer for external merge sort. Currently, its type is integer. So, if users can set more than 2GB to sort buffer size, external merge operator will meet negative sort buffer size. Finally, it will cause significant performance degradation.

        Attachments

        1. TAJO-665.patch
          1 kB
          Hyoungjun Kim

          Activity

            People

            • Assignee:
              hjkim Hyoungjun Kim
              Reporter:
              hyunsik Hyunsik Choi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: