Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9640 RPC Congestion Control with FairCallQueue
  3. HADOOP-10279

Create multiplexer, a requirement for the fair queue

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.5.0
    • None
    • None
    • Reviewed

    Description

      The Multiplexer helps the FairCallQueue decide which of its internal sub-queues to read from during a poll() or take(). It controls the penalty of being in a lower queue. Without the mux, the FairCallQueue would have issues with starvation of low-priority requests.

      The WeightedRoundRobinMultiplexer is an implementation which uses a weighted round robin approach to muxing the sub-queues. It is configured with an integer list pattern.

      For example: 10, 5, 5, 2 means:

      • Read queue 0 10 times
      • Read queue 1 5 times
      • Read queue 2 5 times
      • Read queue 3 2 times
      • Repeat

      Attachments

        1. HADOOP-10279.patch
          11 kB
          Chris Li
        2. HADOOP-10279.patch
          11 kB
          Chris Li
        3. subtask2_add_mux.patch
          11 kB
          Chris Li
        4. WeightedRoundRobinMultiplexer.java
          5 kB
          Chris Li

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            chrilisf Chris Li
            chrilisf Chris Li
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment