Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3325

Adding a tuple to a bag is slow

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.11, 0.12.0, 0.11.1, 0.11.2
    • 0.12.1
    • None
    • None

    Description

      The time it takes to add a tuple to a bag has increased significantly, causing some jobs to take about 50x longer compared to 0.10.1. I've tracked this down to PIG-2923, which has made adding a tuple heavier weight (it now includes some memory estimation).

      Attachments

        1. PIG-3325-benchmark.patch
          10 kB
          Aniket Namadeo Mokashi
        2. PIG-3325.optimize.1.patch
          4 kB
          Mark Wagner
        3. PIG-3325.demo.patch
          1 kB
          Mark Wagner
        4. PIG-3325.4.patch
          5 kB
          Aniket Namadeo Mokashi
        5. PIG-3325.3.patch
          10 kB
          Dmitriy V. Ryaboy
        6. PIG-3325.2.patch
          9 kB
          Dmitriy V. Ryaboy

        Activity

          People

            dvryaboy Dmitriy V. Ryaboy
            mwagner Mark Wagner
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: