Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2769

a simple logic causes very long compiling time on pig 0.10.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.10.0
    • 0.12.0, 0.11.2
    • build
    • None
    • Apache Pig version 0.10.0-SNAPSHOT (rexported)

    Description

      We found the following simple logic will cause very long compiling time for pig 0.10.0, while using pig 0.8.1, everything is fine.

      A = load 'A.txt' using PigStorage() AS (m: int);

      B = FOREACH A {
      days_str = (chararray)
      (m == 1 ? 31:
      (m == 2 ? 28:
      (m == 3 ? 31:
      (m == 4 ? 30:
      (m == 5 ? 31:
      (m == 6 ? 30:
      (m == 7 ? 31:
      (m == 8 ? 31:
      (m == 9 ? 30:
      (m == 10 ? 31:
      (m == 11 ? 30:31)))))))))));
      GENERATE
      days_str as days_str;
      }
      store B into 'B';

      and here's a simple input file example: A.txt
      1
      2
      3

      The pig version we used in the test
      Apache Pig version 0.10.0-SNAPSHOT (rexported)

      Attachments

        1. case1.tar
          10 kB
          Dan Li
        2. PIG-2769.0.patch
          55 kB
          Nick White
        3. PIG-2769.1.patch
          57 kB
          Nick White
        4. PIG-2769.2.patch
          57 kB
          Alan Gates
        5. TEST-org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.TestInputSizeReducerEstimator.txt
          8 kB
          Alan Gates

        Issue Links

          Activity

            People

              njw45 Nick White
              dli@operasolutions.com Dan Li
              Votes:
              1 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: