Pig
  1. Pig
  2. PIG-1589

add test cases for mapreduce operator which use distributed cache

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      '-files filename' can be specified in the parameters for mapreduce operator to send files to distributed cache. Need to add test cases for that.

      1. PIG-1589.1.patch
        13 kB
        Thejas M Nair
      2. TestWordCount.jar
        4 kB
        Thejas M Nair

        Activity

        Hide
        Thejas M Nair added a comment -

        Patch committed to 0.8 branch and trunk.

        Show
        Thejas M Nair added a comment - Patch committed to 0.8 branch and trunk.
        Hide
        Richard Ding added a comment -

        +1

        Show
        Richard Ding added a comment - +1
        Hide
        Thejas M Nair added a comment -

        Unit tests have passed patch is ready for review.
        Summary of changes -
        WordCount.java - The hadoop wordcount example modified to use a stopwords file. The stopwords file is sent using distributed cache.
        TestNativeMapReduce.java - Modified test case to use distributed cache. Changed the class name for the udf in other tests.

        Show
        Thejas M Nair added a comment - Unit tests have passed patch is ready for review. Summary of changes - WordCount.java - The hadoop wordcount example modified to use a stopwords file. The stopwords file is sent using distributed cache. TestNativeMapReduce.java - Modified test case to use distributed cache. Changed the class name for the udf in other tests.
        Hide
        Thejas M Nair added a comment -

        Attachment TestWordCount.jar should go to test/org/apache/pig/test/data/TestWordCount.jar
        [exec] +1 overall.
        [exec]
        [exec] +1 @author. The patch does not contain any @author tags.
        [exec]
        [exec] +1 tests included. The patch appears to include 11 new or modified tests.
        [exec]
        [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
        [exec]
        [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
        [exec]
        [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
        [exec]
        [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

        Show
        Thejas M Nair added a comment - Attachment TestWordCount.jar should go to test/org/apache/pig/test/data/TestWordCount.jar [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 11 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

          People

          • Assignee:
            Thejas M Nair
            Reporter:
            Thejas M Nair
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development