See spec in parent issue (
SPARK-18085) for more details.
This task tracks adding an in-memory implementation for the key-value store abstraction added in
SPARK-20641. This is desired because people might want to avoid having to store this data on disk when running applications, and also because the LevelDB native libraries are not available on all platforms.