Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-1747

Mahout DSL for Flink: add support for different types of indexes (String, long, etc)

    Details

    • Type: Task
    • Status: Closed
    • Priority: Minor
    • Resolution: Implemented
    • Affects Version/s: 0.10.2
    • Fix Version/s: 0.12.0
    • Component/s: Math
    • Labels:
      None

      Description

      For mahout-flink (MAHOUT-1570) rows now can only be indexed with integers. Add support for other types: Long, String, etc.

      See FlinkEngine#toPhysical

        Issue Links

          Activity

          Hide
          agrigorev Alexey Grigorev added a comment -

          Switching to Scala API may solve this problem

          Show
          agrigorev Alexey Grigorev added a comment - Switching to Scala API may solve this problem
          Hide
          Andrew_Palumbo Andrew Palumbo added a comment -

          This should be operable but is untested we can test for String keys by adding the NBTestBaseSuite

          Show
          Andrew_Palumbo Andrew Palumbo added a comment - This should be operable but is untested we can test for String keys by adding the NBTestBaseSuite
          Hide
          Andrew_Palumbo Andrew Palumbo added a comment -

          we still need to implement things like drmParallelizeWithRowLabels(...) to close this out.

          Show
          Andrew_Palumbo Andrew Palumbo added a comment - we still need to implement things like drmParallelizeWithRowLabels(...) to close this out.
          Hide
          smarthi Suneel Marthi added a comment -

          Working on this to add functionality for drmParallelizeWithRowLabels(...)

          Show
          smarthi Suneel Marthi added a comment - Working on this to add functionality for drmParallelizeWithRowLabels(...)
          Hide
          Andrew_Palumbo Andrew Palumbo added a comment -

          Great! I'll start work on allreduceBlock. should I push a squashed commit of my branch to apacke/flink-binding?

          Show
          Andrew_Palumbo Andrew Palumbo added a comment - Great! I'll start work on allreduceBlock. should I push a squashed commit of my branch to apacke/flink-binding?
          Hide
          smarthi Suneel Marthi added a comment -

          yes, lets start pushing code for 0.12.0 to the flink branch.

          Show
          smarthi Suneel Marthi added a comment - yes, lets start pushing code for 0.12.0 to the flink branch.
          Hide
          smarthi Suneel Marthi added a comment -

          All 5 tests in NaiveBayesTestSuite passed for this implementation.

          Show
          smarthi Suneel Marthi added a comment - All 5 tests in NaiveBayesTestSuite passed for this implementation.
          Hide
          dlyubimov Dmitriy Lyubimov added a comment -

          bulk-closing resolved issues

          Show
          dlyubimov Dmitriy Lyubimov added a comment - bulk-closing resolved issues
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Mahout-Quality #3324 (See https://builds.apache.org/job/Mahout-Quality/3324/)
          MAHOUT-1747: Flink: support for different key types (alexey.s.grigoriev: rev 19708f46a41d0bc437f904a383876858a3fef35d)

          • flink/src/main/scala/org/apache/mahout/flinkbindings/drm/FlinkDrm.scala
          • flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAt.scala
          • flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAewB.scala
          • flink/src/test/scala/org/apache/mahout/flinkbindings/RLikeOpsSuite.scala
          • flink/src/main/scala/org/apache/mahout/flinkbindings/package.scala
          • flink/src/main/scala/org/apache/mahout/flinkbindings/blas/package.scala
          • flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAtB.scala
          • math-scala/src/main/scala/org/apache/mahout/math/drm/logical/CheckpointAction.scala
          • flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpCBind.scala
          • flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
            MAHOUT-1747: Mahout DSL for Flink: add support for different types of (smarthi: rev cd4e3cec34aac50a6110839be47f9a1be5550e23)
          • flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Mahout-Quality #3324 (See https://builds.apache.org/job/Mahout-Quality/3324/ ) MAHOUT-1747 : Flink: support for different key types (alexey.s.grigoriev: rev 19708f46a41d0bc437f904a383876858a3fef35d) flink/src/main/scala/org/apache/mahout/flinkbindings/drm/FlinkDrm.scala flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAt.scala flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAewB.scala flink/src/test/scala/org/apache/mahout/flinkbindings/RLikeOpsSuite.scala flink/src/main/scala/org/apache/mahout/flinkbindings/package.scala flink/src/main/scala/org/apache/mahout/flinkbindings/blas/package.scala flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpAtB.scala math-scala/src/main/scala/org/apache/mahout/math/drm/logical/CheckpointAction.scala flink/src/main/scala/org/apache/mahout/flinkbindings/blas/FlinkOpCBind.scala flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala MAHOUT-1747 : Mahout DSL for Flink: add support for different types of (smarthi: rev cd4e3cec34aac50a6110839be47f9a1be5550e23) flink/src/main/scala/org/apache/mahout/flinkbindings/FlinkEngine.scala

            People

            • Assignee:
              smarthi Suneel Marthi
              Reporter:
              agrigorev Alexey Grigorev
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development

                  Agile