Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3915

MapReduce queries in Pigmix outputs different results than Pig's

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.12.0
    • 0.13.0
    • tools
    • None
    • Bug fixes for the Pigmix queries

    Description

      Hello,

      The Pigmix benchmark has 17 queries comparing Pig to MapReduce Java. Some of these queries are not outputting the same results in Pig and MapReduce. Looking into the outputs, it seems the errors reside in the MapReduce code. For example, L6 has no output because the output of the map function sends the wrong key to the reducer: "query_term" (field 3) instead of "timespent" (field 2). Hence an exception is thrown, and there is no output to the query in MapReduce. I am planning to submit a patch once I fixed all the queries in MapReduce

      Thanks,
      Keren

      Attachments

        1. PIG-3915.2.patch
          26 kB
          Keren Ouaknine

        Activity

          People

            kereno Keren Ouaknine
            keren3000 Keren Ouaknine
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: