Pig
  1. Pig
  2. PIG-2511

Enable '*' to skip any fields that have already been generated and cast in other parts of the GENERATE, as in: foo = FOREACH my_relation GENERATE manipulate(foo1) as foo1, *;

    Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.9.1
    • Fix Version/s: None
    • Component/s: grunt, parser
    • Labels:

      Description

      This should work:

      grunt> good_dates = foreach filtered generate CustomFormatToISO(date, 'EEE, dd MMM yyyy HH:mm:ss Z') AS date, *;

      2012-02-06 14:56:23,286 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1108:
      <line 8, column 30> Duplicate schema alias: date
      2012-02-06 14:56:23,286 [main] ERROR org.apache.pig.tools.grunt.Grunt - org.apache.pig.impl.plan.PlanValidationException: ERROR 1108:
      <line 8, column 30> Duplicate schema alias: date
      at org.apache.pig.newplan.logical.visitor.SchemaAliasVisitor.validate(SchemaAliasVisitor.java:74)
      at org.apache.pig.newplan.logical.visitor.SchemaAliasVisitor.visit(SchemaAliasVisitor.java:104)
      at org.apache.pig.newplan.logical.relational.LOGenerate.accept(LOGenerate.java:240)
      at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
      at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
      at org.apache.pig.newplan.logical.visitor.SchemaAliasVisitor.visit(SchemaAliasVisitor.java:99)
      at org.apache.pig.newplan.logical.relational.LOForEach.accept(LOForEach.java:74)
      at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
      at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
      at org.apache.pig.PigServer$Graph.compile(PigServer.java:1661)
      at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1610)
      at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1582)
      at org.apache.pig.PigServer.registerQuery(PigServer.java:584)
      at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:942)
      at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
      at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
      at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
      at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
      at org.apache.pig.Main.run(Main.java:495)
      at org.apache.pig.Main.main(Main.java:111)

        Issue Links

          Activity

          Russell Jurney created issue -
          Daniel Dai made changes -
          Field Original Value New Value
          Labels grunt latin pig grunt latin newbie pig
          Thejas M Nair made changes -
          Link This issue is related to PIG-1693 [ PIG-1693 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Russell Jurney
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Development