Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9640 RPC Congestion Control with FairCallQueue
  3. HADOOP-10279

Create multiplexer, a requirement for the fair queue

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.5.0
    • None
    • None
    • Reviewed

    Description

      The Multiplexer helps the FairCallQueue decide which of its internal sub-queues to read from during a poll() or take(). It controls the penalty of being in a lower queue. Without the mux, the FairCallQueue would have issues with starvation of low-priority requests.

      The WeightedRoundRobinMultiplexer is an implementation which uses a weighted round robin approach to muxing the sub-queues. It is configured with an integer list pattern.

      For example: 10, 5, 5, 2 means:

      • Read queue 0 10 times
      • Read queue 1 5 times
      • Read queue 2 5 times
      • Read queue 3 2 times
      • Repeat

      Attachments

        1. HADOOP-10279.patch
          11 kB
          Chris Li
        2. HADOOP-10279.patch
          11 kB
          Chris Li
        3. subtask2_add_mux.patch
          11 kB
          Chris Li
        4. WeightedRoundRobinMultiplexer.java
          5 kB
          Chris Li

        Issue Links

          Activity

            People

              chrilisf Chris Li
              chrilisf Chris Li
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: