Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3325

Adding a tuple to a bag is slow

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.11, 0.12.0, 0.11.1, 0.11.2
    • Fix Version/s: 0.12.1
    • Component/s: None
    • Labels:
      None

      Description

      The time it takes to add a tuple to a bag has increased significantly, causing some jobs to take about 50x longer compared to 0.10.1. I've tracked this down to PIG-2923, which has made adding a tuple heavier weight (it now includes some memory estimation).

        Attachments

        1. PIG-3325.demo.patch
          1 kB
          Mark Wagner
        2. PIG-3325.optimize.1.patch
          4 kB
          Mark Wagner
        3. PIG-3325.2.patch
          9 kB
          Dmitriy V. Ryaboy
        4. PIG-3325.3.patch
          10 kB
          Dmitriy V. Ryaboy
        5. PIG-3325-benchmark.patch
          10 kB
          Aniket Namadeo Mokashi
        6. PIG-3325.4.patch
          5 kB
          Aniket Namadeo Mokashi

          Activity

            People

            • Assignee:
              dvryaboy Dmitriy V. Ryaboy
              Reporter:
              mwagner Mark Wagner
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: