Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-374 Investigate more efficient intermediate shuffle methods
  3. TAJO-991

Running PullServer on a dedicated JVM process which separates from worker.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.9.0
    • Data Shuffle
    • None

    Description

      Currently PullServer runs on TajoWorker. If a TajoWorker starts Garbage Collector, all fetching tasks which run on other worker are paused during Garbage Collection. Running PullServer on a dedicated JVM process which separates from worker is helpful avoiding stop the all cluster by GC.
      PullServer uses small memory and doesn't share any information and status with TajoWorker.

      Attachments

        Issue Links

          incorporates

          Bug - A problem which impairs or prevents the functions of the product. TAJO-1029 TAJO_PULLSERVER_STANDALONE should be false in default tajo-env.sh

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              hjkim Hyoungjun Kim
              hjkim Hyoungjun Kim
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: