Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3839 Umbrella jira for Pig on Tez Performance Improvements
  3. PIG-4049

Improve performance of Limit following an Orderby on Tez

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • 0.18.0
    • tez
    • None

    Description

      Better algorithms can be applied to improve performance for limit following an order by.

      For eg:

      A = LOAD '/tmp/data' ...;
B = ORDER A by $0 parallel 100;
C = LIMIT B 100;

      Attachments

        Issue Links

          requires

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-1264 Support for limiting output records in OnFileSortedOutput

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-1265 Custom input to fetch source task inputs in order

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              rohini Rohini Palaniswamy
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: