HBase
  1. HBase
  2. HBASE-1734

Priority queue sorted replication policy

    Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Replication
    • Labels:
      None

      Description

      Implement a multi-level priority queue sorted replication policy which plugs into the replication framework (HBASE-1733). Split incoming logs. Sort outbound edits by priority. One option is to consider each column family's replication policy tag as an index into a deadline table for EDF scheduling (http://en.wikipedia.org/wiki/Earliest_deadline_first_scheduling).

        Activity

        Hide
        stack added a comment -

        Moved from 0.21 to 0.22 just after merge of old 0.20 branch into TRUNK.

        Show
        stack added a comment - Moved from 0.21 to 0.22 just after merge of old 0.20 branch into TRUNK.
        Hide
        stack added a comment -

        Moving out of 0.92.0. Pull it back in if you think different.

        Show
        stack added a comment - Moving out of 0.92.0. Pull it back in if you think different.
        Hide
        Andrew Purtell added a comment -

        We have implemented a prototype in a formal work with HBase, and obtained some promising results as discussed in the mailing list. The work can be refined and contributed to the community in the form of a patch if desired. Let me know.

        Yes we would be interested in hearing more. Do you have a publicly available paper, technical report, and/or source code?

        Promoted to top level new feature issue.

        Show
        Andrew Purtell added a comment - We have implemented a prototype in a formal work with HBase, and obtained some promising results as discussed in the mailing list. The work can be refined and contributed to the community in the form of a patch if desired. Let me know. Yes we would be interested in hearing more. Do you have a publicly available paper, technical report, and/or source code? Promoted to top level new feature issue.
        Hide
        Alvaro Garcia Recuero added a comment -

        Andrew Purtell I will shortly send you an email in that regard containing all the information.

        Show
        Alvaro Garcia Recuero added a comment - Andrew Purtell I will shortly send you an email in that regard containing all the information.
        Hide
        Alvaro Garcia Recuero added a comment -

        Here is my proposal Andrew Purtell: https://docs.google.com/document/d/1xFEDykLcNVWrfPIWeDycvZ44eMpXGioZ4B7fP3Bl0rE/edit?usp=sharing. If validated I will upload here the design doc later. Will post further information soon from my side. Thank you.

        Show
        Alvaro Garcia Recuero added a comment - Here is my proposal Andrew Purtell : https://docs.google.com/document/d/1xFEDykLcNVWrfPIWeDycvZ44eMpXGioZ4B7fP3Bl0rE/edit?usp=sharing . If validated I will upload here the design doc later. Will post further information soon from my side. Thank you.
        Hide
        Alvaro Garcia Recuero added a comment -

        The full paper has been also just published in the IEEE proceedings of CloudCom '13. Namely, Quality-of-Data for Consistency Levels in Geo-replicated Cloud Data Stores, http://goo.gl/Uc297X

        Show
        Alvaro Garcia Recuero added a comment - The full paper has been also just published in the IEEE proceedings of CloudCom '13. Namely, Quality-of-Data for Consistency Levels in Geo-replicated Cloud Data Stores, http://goo.gl/Uc297X
        Hide
        Andrew Purtell added a comment -

        Unfortunately the paper is behind a paywall Alvaro Garcia Recuero. If you like you could attach the google doc here.

        Show
        Andrew Purtell added a comment - Unfortunately the paper is behind a paywall Alvaro Garcia Recuero . If you like you could attach the google doc here.

          People

          • Assignee:
            Unassigned
            Reporter:
            Andrew Purtell
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development