Mahout
  1. Mahout
  2. MAHOUT-956

RowIdJob fails if logsCRCfilter is not set.

        Details

        • Type: Bug Bug
        • Status: Closed
        • Priority: Minor Minor
        • Resolution: Fixed
        • Affects Version/s: 0.6
        • Fix Version/s: 0.6
        • Component/s: Math
        • Labels:
          None
        • Environment:

          0.6 snapshot from trunk

          Description

          RowIdJob when executed doesn't ignore '_SUCCESS' or '*crc' files as PathFilters.logsCRCFilter is not set.

          1. Text File
            MAHOUT-956.patch
            1 kB
            Suneel Marthi

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            Suneel Marthi added a comment -

            Passing PathFilters.logCRCFilters() fixes the issue.

            Show
            Suneel Marthi added a comment - Passing PathFilters.logCRCFilters() fixes the issue.
            Hide
            Permalink
            Suneel Marthi added a comment -

            fixed patch for Mahout-956

            Show
            Suneel Marthi added a comment - fixed patch for Mahout-956
            Hide
            Permalink
            Suneel Marthi added a comment -

            Pass in PathFilters.logCRCFilters as parameter when converting the vectors to matrix so as to ignore any .crc and '_SUCCESS'/'_logs' files.

            Show
            Suneel Marthi added a comment - Pass in PathFilters.logCRCFilters as parameter when converting the vectors to matrix so as to ignore any .crc and '_SUCCESS'/'_logs' files.
            Hide
            Permalink
            Grant Ingersoll added a comment -

            Small enough that it should go in 0.6

            Show
            Grant Ingersoll added a comment - Small enough that it should go in 0.6
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Mahout-Quality #1323 (See https://builds.apache.org/job/Mahout-Quality/1323/)
            MAHOUT-956: filter logs, crc

            gsingers : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1236898
            Files :

            • /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/vectors/RowIdJob.java
            Show
            Hudson added a comment - Integrated in Mahout-Quality #1323 (See https://builds.apache.org/job/Mahout-Quality/1323/ ) MAHOUT-956 : filter logs, crc gsingers : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1236898 Files : /mahout/trunk/integration/src/main/java/org/apache/mahout/utils/vectors/RowIdJob.java

              People

              • Assignee:
                Unassigned
                Reporter:
                Suneel Marthi
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development