Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4149

Rounding issue in FindQuantiles

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • impl
    • None
    • Reviewed

    Description

      In FindQuantiles, Pig calculates an integer toSkip inside sample, and skip "toSkip" sample records to find the next boundary. However, toSkip should not be an integer, this will cause rounding issue and all the remainder will goes to the last partition.

      Attachments

        1. PIG-4149-1.patch
          6 kB
          Daniel Dai
        2. PIG-4149-0.patch
          1 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: