Pig
  1. Pig
  2. PIG-1589

add test cases for mapreduce operator which use distributed cache

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      '-files filename' can be specified in the parameters for mapreduce operator to send files to distributed cache. Need to add test cases for that.

      1. TestWordCount.jar
        4 kB
        Thejas M Nair
      2. PIG-1589.1.patch
        13 kB
        Thejas M Nair

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        12d 1h 2m 1 Thejas M Nair 13/Sep/10 20:13
        Patch Available Patch Available Resolved Resolved
        22h 47m 1 Thejas M Nair 14/Sep/10 19:00
        Resolved Resolved Closed Closed
        94d 4h 44m 1 Olga Natkovich 17/Dec/10 22:45
        Olga Natkovich made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Thejas M Nair made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Hide
        Thejas M Nair added a comment -

        Patch committed to 0.8 branch and trunk.

        Show
        Thejas M Nair added a comment - Patch committed to 0.8 branch and trunk.
        Hide
        Richard Ding added a comment -

        +1

        Show
        Richard Ding added a comment - +1
        Hide
        Thejas M Nair added a comment -

        Unit tests have passed patch is ready for review.
        Summary of changes -
        WordCount.java - The hadoop wordcount example modified to use a stopwords file. The stopwords file is sent using distributed cache.
        TestNativeMapReduce.java - Modified test case to use distributed cache. Changed the class name for the udf in other tests.

        Show
        Thejas M Nair added a comment - Unit tests have passed patch is ready for review. Summary of changes - WordCount.java - The hadoop wordcount example modified to use a stopwords file. The stopwords file is sent using distributed cache. TestNativeMapReduce.java - Modified test case to use distributed cache. Changed the class name for the udf in other tests.
        Thejas M Nair made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Thejas M Nair made changes -
        Field Original Value New Value
        Attachment TestWordCount.jar [ 12454473 ]
        Attachment PIG-1589.1.patch [ 12454474 ]
        Hide
        Thejas M Nair added a comment -

        Attachment TestWordCount.jar should go to test/org/apache/pig/test/data/TestWordCount.jar
        [exec] +1 overall.
        [exec]
        [exec] +1 @author. The patch does not contain any @author tags.
        [exec]
        [exec] +1 tests included. The patch appears to include 11 new or modified tests.
        [exec]
        [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
        [exec]
        [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
        [exec]
        [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
        [exec]
        [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

        Show
        Thejas M Nair added a comment - Attachment TestWordCount.jar should go to test/org/apache/pig/test/data/TestWordCount.jar [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 11 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
        Thejas M Nair created issue -

          People

          • Assignee:
            Thejas M Nair
            Reporter:
            Thejas M Nair
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development