Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-12636

Full rebalance instead of a historical one

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9, 2.8.1
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Fixed race when full rebalance could be triggered instead of a historical one on concurrent node join

      Description

      Common configuration:
      1)4 nodes
      2)3-4 caches
      3)IGNITE_PDS_WAL_REBALANCE_THRESHOLD=500
      4)walHistorySize=500

      5)IGNITE_PDS_MAX_CHECKPOINT_MEMORY_HISTORY_SIZE=500

      Scenario:
      1)Load a lot of data.
      2)Start the transaction on some client but DON'T close it.
      3)Stop the server node.
      4)Start the server.
      5)PME should be started
      6)Kill the client started the transaction

      Expected result:
      Rebalance is HISTORICAL.

      Actual result:
      Rebalance is full:

       

      [12:01:58,613][INFO]sys-#95[GridDhtPartitionDemander] Started rebalance routine [cache_group_6, supplier=5462dc46-f71f-49d8-8a1d-d9d69c3e372a, topic=0, fullPartitions=[23], histPartitions=[]]
       [12:01:58,614][INFO]sys-#109[GridDhtPartitionDemander] Started rebalance routine [cache_group_6, supplier=8ab78982-0bcf-494f-a634-f3fb2d78328f, topic=0, fullPartitions=[1], histPartitions=[]]
       [12:01:58,614][INFO]sys-#101[GridDhtPartitionDemander] Started rebalance routine [cache_group_6, supplier=8ab78982-0bcf-494f-a634-f3fb2d78328f, topic=1, fullPartitions=[55], histPartitions=[]]
       [12:01:59,004][INFO]sys-#99[GridDhtPartitionDemander] Started rebalance routine [cache_group_4_118, supplier=5462dc46-f71f-49d8-8a1d-d9d69c3e372a, topic=0, fullPartitions=[5], histPartitions=[]]
       [12:01:59,004][INFO]sys-#96[GridDhtPartitionDemander] Started rebalance routine [cache_group_4_118, supplier=48e2a2b5-2119-4b5c-873c-eb8d0c436b6a, topic=0, fullPartitions=[15], histPartitions=[]]
       [12:01:59,196][INFO]sys-#104[GridDhtPartitionDemander] Started rebalance routine [cache_group_2_058, supplier=48e2a2b5-2119-4b5c-873c-eb8d0c436b6a, topic=0, fullPartitions=[21], histPartitions=[]]
       [12:01:59,196][INFO]sys-#95[GridDhtPartitionDemander] Started rebalance routine [cache_group_2_058, supplier=8ab78982-0bcf-494f-a634-f3fb2d78328f, topic=0, fullPartitions=[19], histPartitions=[]]

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                maliev Mirza Aliev
                Reporter:
                maliev Mirza Aliev
                Reviewer:
                Ivan Rakov
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m