Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-17407

The snapshot rate limit does not work correctly when set to values ​​greater than 100 MB per second.

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.13
    • 2.14
    • None

    Description

      The snapshot rate limit does not work correctly when set to values ​​greater than 100 MB per second.

      Currently, the snapshot transfer rate is limited by the BasicRateLimiter.
      Testing shows that limiter is unable to give more than ~119 millions permits per second.

              long dataSize = U.GB;
      
              BasicRateLimiter limiter = new BasicRateLimiter(dataSize / 2);
      
              int blockSize = IgniteSnapshotManager.SNAPSHOT_LIMITED_TRANSFER_BLOCK_SIZE_BYTES;
      
              long start = System.currentTimeMillis();
      
              for (long i = 0; i < dataSize; i+=blockSize)
                  limiter.acquire(blockSize);
      
              long totalSec = TimeUnit.MILLISECONDS.toSeconds(System.currentTimeMillis() - start);
      
              System.out.println("Speed= " + (dataSize / totalSec));
      

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            xtern Pavel Pereslegin
            xtern Pavel Pereslegin
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                Slack

                  Issue deployment