Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-3018

Cache affinity calculation is slow with large nodes number

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0
    • Component/s: cache
    • Labels:

      Description

      With large number of cache server nodes (> 200) RendezvousAffinityFunction and FairAffinityFunction work pretty slow .

      For RendezvousAffinityFunction.assignPartitions can take hundredes of milliseconds, for FairAffinityFunction it can take seconds.

      For RendezvousAffinityFunction most time is spent in MD5 hash calculation and nodes list sorting. As optimization we can try to cache

      {partion, node}

      MD5 hash or try another hash function. Also several minor optimizations are possible (avoid unncecessary allocations, only one thread local 'get', etc).

        Attachments

        1. balanced.600.png
          15 kB
          Taras Ledkov
        2. balanced.400.png
          14 kB
          Taras Ledkov
        3. balanced.256.png
          14 kB
          Taras Ledkov
        4. balanced.200.png
          13 kB
          Taras Ledkov
        5. balanced.128.png
          13 kB
          Taras Ledkov
        6. balanced.100.png
          13 kB
          Taras Ledkov
        7. balanced.064.png
          12 kB
          Taras Ledkov
        8. balanced.016.png
          23 kB
          Taras Ledkov
        9. balanced.008.png
          19 kB
          Taras Ledkov
        10. balanced.004.png
          17 kB
          Taras Ledkov
        11. balanced.003.png
          14 kB
          Taras Ledkov
        12. 600.png
          16 kB
          Taras Ledkov
        13. 400.png
          14 kB
          Taras Ledkov
        14. 256.png
          14 kB
          Taras Ledkov
        15. 200.png
          14 kB
          Taras Ledkov
        16. 128.png
          13 kB
          Taras Ledkov
        17. 100.png
          13 kB
          Taras Ledkov
        18. 064.png
          12 kB
          Taras Ledkov
        19. 016.png
          23 kB
          Taras Ledkov
        20. 008.png
          19 kB
          Taras Ledkov
        21. 004.png
          16 kB
          Taras Ledkov
        22. 003.png
          14 kB
          Taras Ledkov

          Issue Links

            Activity

              People

              • Assignee:
                tledkov-gridgain Taras Ledkov
                Reporter:
                sboikov Semen Boikov
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: