Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-5162 Fix failing e2e tests with spark exec type
  3. PIG-5186

Support aggregate warnings with Spark engine

          Details

          • Type: Sub-task
          • Status: Closed
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: spark-branch
          • Component/s: spark
          • Labels:
            None
          • Hadoop Flags:
            Reviewed

            Description

            Looks like we don't get aggregate warning stats when using Spark as exec engine:

            ./test_harness.pl::TestDriverPig::compareScript INFO Check failed: regex match of <Encountered Warning DIVIDE_BY_ZERO 2387 time.*> expected in stderr

              Attachments

              1. PIG-5186.0.patch
                30 kB
                Adam Szita
              2. PIG-5186.1.patch
                31 kB
                Adam Szita
              3. PIG-5186.2.patch
                32 kB
                Adam Szita
              4. PIG-5186.3.patch
                32 kB
                Adam Szita

                Issue Links

                relates to

                Improvement - An improvement or enhancement to an existing feature or task. PIG-5234 Fix HiveUDF_7 test to properly validate counter access from UDF

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Open
                links to

                Web Link RB

                  Activity

                    People

                    • Assignee:
                      szita Adam Szita
                      Reporter:
                      szita Adam Szita
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      5 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: