Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-1821

Use a mahout-flink-conf.yaml configuration file for Mahout specific Flink configuration

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Implemented
    • Affects Version/s: 0.11.2
    • Fix Version/s: 0.12.0
    • Component/s: Flink
    • Labels:
      None

      Description

      Mahout on Flink requires a few Mahout specific configuration parameters. These configurations should be set in a $MAHOUT_HOME/conf/mahout-flink-conf.yaml file. The values in it will override the user's flink-conf.yaml file if the same key is set in both.

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user smarthi opened a pull request:

        https://github.com/apache/mahout/pull/213

        MAHOUT-1821: Use a mahout-flink-conf.yaml configuration file for Maho…

        …ut specific Flink configuration

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/smarthi/mahout MAHOUT-1821

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/mahout/pull/213.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #213


        commit fbe8734d749d48ff59a82f2837377b35f91ea8bf
        Author: smarthi <smarthi@apache.org>
        Date: 2016-04-09T00:03:02Z

        MAHOUT-1821: Use a mahout-flink-conf.yaml configuration file for Mahout specific Flink configuration


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user smarthi opened a pull request: https://github.com/apache/mahout/pull/213 MAHOUT-1821 : Use a mahout-flink-conf.yaml configuration file for Maho… …ut specific Flink configuration You can merge this pull request into a Git repository by running: $ git pull https://github.com/smarthi/mahout MAHOUT-1821 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/mahout/pull/213.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #213 commit fbe8734d749d48ff59a82f2837377b35f91ea8bf Author: smarthi <smarthi@apache.org> Date: 2016-04-09T00:03:02Z MAHOUT-1821 : Use a mahout-flink-conf.yaml configuration file for Mahout specific Flink configuration
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user andrewpalumbo commented on the pull request:

        https://github.com/apache/mahout/pull/213#issuecomment-207659653

        I think that we should only set the properties that we need for our stuff. This will override any properties set by the user in their `flink-config.yaml` file.

        Show
        githubbot ASF GitHub Bot added a comment - Github user andrewpalumbo commented on the pull request: https://github.com/apache/mahout/pull/213#issuecomment-207659653 I think that we should only set the properties that we need for our stuff. This will override any properties set by the user in their `flink-config.yaml` file.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user andrewpalumbo commented on the pull request:

        https://github.com/apache/mahout/pull/213#issuecomment-207660882

        +1

        Show
        githubbot ASF GitHub Bot added a comment - Github user andrewpalumbo commented on the pull request: https://github.com/apache/mahout/pull/213#issuecomment-207660882 +1
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user smarthi commented on the pull request:

        https://github.com/apache/mahout/pull/213#issuecomment-207661533

        Closing this PR, merged to 'flink-binding'

        Show
        githubbot ASF GitHub Bot added a comment - Github user smarthi commented on the pull request: https://github.com/apache/mahout/pull/213#issuecomment-207661533 Closing this PR, merged to 'flink-binding'
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user smarthi closed the pull request at:

        https://github.com/apache/mahout/pull/213

        Show
        githubbot ASF GitHub Bot added a comment - Github user smarthi closed the pull request at: https://github.com/apache/mahout/pull/213
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Mahout-Quality #3324 (See https://builds.apache.org/job/Mahout-Quality/3324/)
        MAHOUT-1821: Use a mahout-flink-conf.yaml configuration file for Mahout (smarthi: rev 7c275f06e618624ac5bdc269b19d328a6c2b6983)

        • flink/src/test/scala/org/apache/mahout/flinkbindings/DistributedFlinkSuite.scala
        • conf/flink-config.yaml
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Mahout-Quality #3324 (See https://builds.apache.org/job/Mahout-Quality/3324/ ) MAHOUT-1821 : Use a mahout-flink-conf.yaml configuration file for Mahout (smarthi: rev 7c275f06e618624ac5bdc269b19d328a6c2b6983) flink/src/test/scala/org/apache/mahout/flinkbindings/DistributedFlinkSuite.scala conf/flink-config.yaml
        Hide
        smarthi Suneel Marthi added a comment -

        Closing issues following Mahout 0.12.0 release on April 11, 2016

        Show
        smarthi Suneel Marthi added a comment - Closing issues following Mahout 0.12.0 release on April 11, 2016

          People

          • Assignee:
            smarthi Suneel Marthi
            Reporter:
            Andrew_Palumbo Andrew Palumbo
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development

                Agile