Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None

      Description

      Spark bindings for Mahout DRM.
      DRM DSL.

      Disclaimer. This will all be experimental at this point.

      The idea is to wrap DRM by Spark RDD with support of some basic functionality, perhaps some humble beginning of Cost-based optimizer

      (0) Spark serialization support for Vector, Matrix
      (1) Bagel transposition
      (2) slim X'X
      (2a) not-so-slim X'X
      (3) blockify() (compose RDD containing vertical blocks of original input)
      (4) read/write Mahout DRM off HDFS
      (5) A'B

      ...

        Attachments

        1. ScalaSparkBindings.pdf
          569 kB
          Dmitriy Lyubimov
        2. BindingsStack.jpg
          72 kB
          Dmitriy Lyubimov

          Issue Links

            Activity

              People

              • Assignee:
                dlyubimov Dmitriy Lyubimov
                Reporter:
                dlyubimov Dmitriy Lyubimov
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: