Uploaded image for project: 'Apache AsterixDB'
  1. Apache AsterixDB
  2. ASTERIXDB-3220

Unnecessary wait for all partitions IO ops on replica sync

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.8
    • 0.9.9
    • REPL - Replication

    Description

      When waiting for datasets of a partition replica to complete their IO ops, we currently unnecessarily wait for IO ops of all partitions which could result in slowing down the replica sync process significantly. We should
      wait for the target partition IO ops only.

      Attachments

        Activity

          Commit cc7d89ccbde59c209fdbe8a819c95fa567ea9224 in asterixdb's branch refs/heads/master from Murtadha Makki Al Hubail
          [ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=cc7d89ccbd ]

          ASTERIXDB-3220[REPL] Allow waiting for IO on specific dataset partition

          • user model changes: no
          • storage format changes: no
          • interface changes: yes

          Details:

          • Add API to wait for IO on a specific dataset partition.
          • When waiting for a partition replica IO ops to finish, only wait
            for the replica partition rather than all partitions.

          Change-Id: I90f311f602b3c8526556f64d7b25672981fac320
          Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17633
          Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
          Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
          Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

          jira-bot ASF subversion and git services added a comment - Commit cc7d89ccbde59c209fdbe8a819c95fa567ea9224 in asterixdb's branch refs/heads/master from Murtadha Makki Al Hubail [ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=cc7d89ccbd ] ASTERIXDB-3220 [REPL] Allow waiting for IO on specific dataset partition user model changes: no storage format changes: no interface changes: yes Details: Add API to wait for IO on a specific dataset partition. When waiting for a partition replica IO ops to finish, only wait for the replica partition rather than all partitions. Change-Id: I90f311f602b3c8526556f64d7b25672981fac320 Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17633 Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

          People

            mhubail Murtadha Makki Al Hubail
            mhubail Murtadha Makki Al Hubail
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: