Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-374 Investigate more efficient intermediate shuffle methods
  3. TAJO-991

Running PullServer on a dedicated JVM process which separates from worker.

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0
    • Component/s: Data Shuffle
    • Labels:
      None

      Description

      Currently PullServer runs on TajoWorker. If a TajoWorker starts Garbage Collector, all fetching tasks which run on other worker are paused during Garbage Collection. Running PullServer on a dedicated JVM process which separates from worker is helpful avoiding stop the all cluster by GC.
      PullServer uses small memory and doesn't share any information and status with TajoWorker.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hjkim Hyoungjun Kim
                Reporter:
                hjkim Hyoungjun Kim
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: