Mahout
  1. Mahout
  2. MAHOUT-956

RowIdJob fails if logsCRCfilter is not set.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.6
    • Fix Version/s: 0.6
    • Component/s: Math
    • Labels:
      None
    • Environment:

      0.6 snapshot from trunk

      Description

      RowIdJob when executed doesn't ignore '_SUCCESS' or '*crc' files as PathFilters.logsCRCFilter is not set.

      1. MAHOUT-956.patch
        1 kB
        Suneel Marthi

        Activity

        Hide
        Suneel Marthi added a comment -

        Passing PathFilters.logCRCFilters() fixes the issue.

        Show
        Suneel Marthi added a comment - Passing PathFilters.logCRCFilters() fixes the issue.
        Hide
        Suneel Marthi added a comment -

        fixed patch for Mahout-956

        Show
        Suneel Marthi added a comment - fixed patch for Mahout-956
        Hide
        Suneel Marthi added a comment -

        Pass in PathFilters.logCRCFilters as parameter when converting the vectors to matrix so as to ignore any .crc and '_SUCCESS'/'_logs' files.

        Show
        Suneel Marthi added a comment - Pass in PathFilters.logCRCFilters as parameter when converting the vectors to matrix so as to ignore any .crc and '_SUCCESS'/'_logs' files.
        Hide
        Grant Ingersoll added a comment -

        Small enough that it should go in 0.6

        Show
        Grant Ingersoll added a comment - Small enough that it should go in 0.6
        Hide
        Hudson added a comment -

        Integrated in Mahout-Quality #1323 (See https://builds.apache.org/job/Mahout-Quality/1323/)
        MAHOUT-956: filter logs, crc

        gsingers : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1236898
        Files :

        • /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/vectors/RowIdJob.java
        Show
        Hudson added a comment - Integrated in Mahout-Quality #1323 (See https://builds.apache.org/job/Mahout-Quality/1323/ ) MAHOUT-956 : filter logs, crc gsingers : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1236898 Files : /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/vectors/RowIdJob.java

          People

          • Assignee:
            Unassigned
            Reporter:
            Suneel Marthi
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development