Details
-
New Feature
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
None
-
None
-
None
-
None
-
Should work on any environment
Description
Work on a computation model for services on the grid. The model would include:
Various tools for defining clients and servers of the service, and at the least a C++ and Java instantiation of the abstractions
Logical definitions of how to partition work onto a set of servers, i.e. a generalized shard implementation
A few useful abstractions like locks (exclusive and RW, fairness), leader election, transactions,
Various communication models for groups of servers belonging to a service, such as broadcast, unicast, etc.
Tools for assuring QoS, reliability, managing pools of servers for a service with spares, etc.
Integration with HDFS for persistence, as well as access to local filesystems
Integration with ZooKeeper so that applications can use the namespace
Attachments
Issue Links
- Is contained by
-
YARN-896 Roll up for long-lived services in YARN
- Open