Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2769

a simple logic causes very long compiling time on pig 0.10.0

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.12.0, 0.11.2
    • Component/s: build
    • Labels:
      None
    • Environment:

      Apache Pig version 0.10.0-SNAPSHOT (rexported)

      Description

      We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.

      A = load 'A.txt' using PigStorage() AS (m: int);

      B = FOREACH A {
      days_str = (chararray)
      (m == 1 ? 31:
      (m == 2 ? 28:
      (m == 3 ? 31:
      (m == 4 ? 30:
      (m == 5 ? 31:
      (m == 6 ? 30:
      (m == 7 ? 31:
      (m == 8 ? 31:
      (m == 9 ? 30:
      (m == 10 ? 31:
      (m == 11 ? 30:31)))))))))));
      GENERATE
      days_str as days_str;
      }
      store B into 'B';

      and here's a simple input file example: A.txt
      1
      2
      3

      The pig version we used in the test
      Apache Pig version 0.10.0-SNAPSHOT (rexported)

        Attachments

        1. case1.tar
          10 kB
          Dan Li
        2. PIG-2769.0.patch
          55 kB
          Nick White
        3. PIG-2769.1.patch
          57 kB
          Nick White
        4. PIG-2769.2.patch
          57 kB
          Alan Gates
        5. TEST-org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.TestInputSizeReducerEstimator.txt
          8 kB
          Alan Gates

          Issue Links

            Activity

              People

              • Assignee:
                njw45 Nick White
                Reporter:
                dli@operasolutions.com Dan Li
              • Votes:
                1 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: