Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10641

Introduce Coordination Engine interface

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      Coordination Engine (CE) is a system, which allows to agree on a sequence of events in a distributed system. In order to be reliable CE should be distributed by itself.
      Coordination Engine can be based on different algorithms (paxos, raft, 2PC, zab) and have different implementations, depending on use cases, reliability, availability, and performance requirements.
      CE should have a common API, so that it could serve as a pluggable component in different projects. The immediate beneficiaries are HDFS (HDFS-6469) and HBase (HBASE-10909).
      First implementation is proposed to be based on ZooKeeper.

        Attachments

        1. ce-tla.zip
          38 kB
          Michael Parkin
        2. HADOOP-10641.patch
          65 kB
          Plamen Jeliazkov
        3. HADOOP-10641.patch
          72 kB
          Plamen Jeliazkov
        4. HADOOP-10641.patch
          60 kB
          Plamen Jeliazkov
        5. HADOOP-10641.patch
          75 kB
          Plamen Jeliazkov
        6. HADOOP-10641.patch
          60 kB
          Konstantin Boudnik
        7. hadoop-coordination.patch
          63 kB
          Mikhail Antonov
        8. NNThroughputBenchmark Results.pdf
          61 kB
          Henry Wang
        9. zkbench.pdf
          49 kB
          Henry Wang
        10. zkCEBenchmark.pdf
          46 kB
          Andrey Stepachev

          Issue Links

            Activity

              People

              • Assignee:
                zero45 Plamen Jeliazkov
                Reporter:
                shv Konstantin Shvachko
              • Votes:
                2 Vote for this issue
                Watchers:
                53 Start watching this issue

                Dates

                • Created:
                  Updated: