Pig
  1. Pig
  2. PIG-954

Skewed join fails when pig.skewedjoin.reduce.memusage is not configured

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None

      Description

      query fails if pig.skewedjoin.reduce.memusage is not configured.

      1. PIG-954.patch
        3 kB
        Ying He
      2. PIG-954.patch2
        5 kB
        Ying He

        Issue Links

          Activity

          Hide
          Olga Natkovich added a comment -

          patch committed. Thanks, Ying for a quick fix!

          Show
          Olga Natkovich added a comment - patch committed. Thanks, Ying for a quick fix!
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12419336/PIG-954.patch2
          against trunk revision 814016.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/5/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/5/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/5/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12419336/PIG-954.patch2 against trunk revision 814016. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/5/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/5/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/5/console This message is automatically generated.
          Hide
          Olga Natkovich added a comment -

          +1 on the code changes. Need to wait for test results

          Show
          Olga Natkovich added a comment - +1 on the code changes. Need to wait for test results
          Hide
          Ying He added a comment -

          add JUnit test

          Show
          Ying He added a comment - add JUnit test
          Hide
          Ying He added a comment -

          use final variable to define the default value of pig.skewedjoin.reduce.memusage

          Show
          Ying He added a comment - use final variable to define the default value of pig.skewedjoin.reduce.memusage
          Hide
          Ying He added a comment -

          use default value if pig.skewedjoin.reduce.memusage is not configured in pig property file

          Show
          Ying He added a comment - use default value if pig.skewedjoin.reduce.memusage is not configured in pig property file
          Hide
          Ying He added a comment -

          the sampling job fails when pig.skewedjoin.reduce.memusage is not configured in pig property file.

          Show
          Ying He added a comment - the sampling job fails when pig.skewedjoin.reduce.memusage is not configured in pig property file.

            People

            • Assignee:
              Ying He
              Reporter:
              Ying He
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development