Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-1346

Spark Bindings (DRM)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.9
    • 0.10.0
    • None
    • None

    Description

      Spark bindings for Mahout DRM.
      DRM DSL.

      Disclaimer. This will all be experimental at this point.

      The idea is to wrap DRM by Spark RDD with support of some basic functionality, perhaps some humble beginning of Cost-based optimizer

      (0) Spark serialization support for Vector, Matrix
      (1) Bagel transposition
      (2) slim X'X
      (2a) not-so-slim X'X
      (3) blockify() (compose RDD containing vertical blocks of original input)
      (4) read/write Mahout DRM off HDFS
      (5) A'B

      ...

      Attachments

        1. BindingsStack.jpg
          72 kB
          Dmitriy Lyubimov
        2. ScalaSparkBindings.pdf
          569 kB
          Dmitriy Lyubimov

        Issue Links

          Activity

            People

              dlyubimov Dmitriy Lyubimov
              dlyubimov Dmitriy Lyubimov
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: