Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3782

PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.1, 0.12.0, 0.11.1
    • Fix Version/s: 0.12.1, 0.13.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      a = load '1.txt' as (a0:int, a1, a2:bag{});
      b = load '2.txt' as (b0:int, b1);
      c = foreach a generate a0, flatten(a2) as (q1, q2);
      d = join c by a0, b by b0;
      e = foreach d generate a0, q1, q2;
      f = foreach e generate a0, (int)q1, (int)q2;
      store f into 'output';
      

      This pig script fails with
      2014-02-27 11:49:45,657 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2229: Couldn't find matching uid -1 for project (Name: Project Type: bytearray Uid: 13 Input: 0 Column: 1)

        Attachments

        1. pig-3782-v01.patch
          4 kB
          Koji Noguchi
        2. PIG-3782-2.patch
          2 kB
          Jianyong Dai

          Activity

            People

            • Assignee:
              daijy Jianyong Dai
              Reporter:
              knoguchi Koji Noguchi
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: