Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-2714

Throttle migration replay

Agile BoardAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Low
    • Resolution: Fixed
    • 0.7.7, 0.8.1
    • None
    • None

    Description

      As reported on the mailing list,

      - I have a lot of schema updates (there are 2067 rows in the system.Schema CF).
      - The live node loads migrations 1-1000, and sends them to the recovering node (Migration.getLocalMigrations())
      - Soon afterwards, the live node checks the schema version on the recovering node and finds it has moved by a little - say it has applied the first 3 migrations. It then loads migrations 3-1003, and sends them to the node.
      - This process is repeated very quickly (sends migrations 6-1006, 9-1009, etc).
      

      The source of the problem is that MigrationManager.onChange will send out a full (up to 1000 migrations) replay, every time the target's schema version changes.

      Attachments

        1. 2714.txt
          4 kB
          Jonathan Ellis
        2. 2714-v2.txt
          4 kB
          Jonathan Ellis

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jbellis Jonathan Ellis Assign to me
            jbellis Jonathan Ellis
            Jonathan Ellis
            Gary Dusbabek
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment