[IGNITE-1251] Develop a library of distributed data types for ML applications.

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: data structures
• Assignee: Vladisav Jelisavcic
• Reporter: Nikita Ivanov
• Created: 14/Aug/15 16:26
• Updated: 19/Mar/16 06:52

Description

Essentially, we want to make Ignite as friendly to ML application as possible. The first step here is to develop a set of basic (distributed) data structures that can be used in implementing ML algorithms.

We should borrow most of the ideas from the great Apache Spark project: https://spark.apache.org/docs/latest/mllib-data-types.html Our implementation should be based on Ignite data grid / compute grid capabilities (instead of Spark RDD concept).

Implementation language should be Java (as well as making sure that these Java APIs can be used relatively pain-free from other JVM-based languages such as Scala and Groovy).

This has also been submitted to: http://eecs.oregonstate.edu/capstone/submission/?page=allproposals