Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3915

MapReduce queries in Pigmix outputs different results than Pig's

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.13.0
    • Component/s: tools
    • Labels:
      None
    • Release Note:
      Bug fixes for the Pigmix queries

      Description

      Hello,

      The Pigmix benchmark has 17 queries comparing Pig to MapReduce Java. Some of these queries are not outputting the same results in Pig and MapReduce. Looking into the outputs, it seems the errors reside in the MapReduce code. For example, L6 has no output because the output of the map function sends the wrong key to the reducer: "query_term" (field 3) instead of "timespent" (field 2). Hence an exception is thrown, and there is no output to the query in MapReduce. I am planning to submit a patch once I fixed all the queries in MapReduce

      Thanks,
      Keren

        Attachments

        1. PIG-3915.2.patch
          26 kB
          Keren Ouaknine

          Activity

            People

            • Assignee:
              kereno Keren Ouaknine
              Reporter:
              keren3000 Keren Ouaknine
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: