Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2030

Merged join/cogroup does not automatically ship loader

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.9.0
    • impl
    • None
    • Reviewed

    Description

      The following script fail due to TableLoader class not found (If the jar is in classpath):

      a = load '/user/pig/tests/data/zebra/singlefile/studentsortedtab10k' using org.apache.hadoop.zebra.pig.TableLoader('', 'sorted');
      b = load '/user/pig/tests/data/zebra/singlefile/votersortedtab10k' using org.apache.hadoop.zebra.pig.TableLoader('', 'sorted');
      g = cogroup a by $0, b by $0 using 'merge';
      store g into '/user/pig/out/jianyong.1304374720/ZebraMapCogrp_1.out';
      

      If we use register, the error goes away. However, Pig always ship jars containing LoadFunc automatically. It should be the same for merged cogroup/join.

      Attachments

        1. PIG-2030-1.patch
          6 kB
          Daniel Dai
        2. PIG-2030-2.patch
          6 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: