[PIG-2353] RANK function like in SQL - ASF JIRA

XML

Word

Printable

JSON

Release Note:

Hide
Pig includes a new RANK operator:
RANK <relation> ( BY <column> (ASC|DES)? (DENSE)? )?
This operator prepends a consecutive integer to each tuple in the relation starting from 1.
If the BY clause is present, RANK sorts the relation before ranking it, otherwise it uses the order in which it receives the relation (e.g. the order in which the relation is stored if RANK is performed right after a LOAD).
The DENSE modifier produces a dense rank, which has no gaps in it regardless of ties.

RANK is now a reserved keyword and is *not* backward compatible.
Please review your scripts to avoid usage of RANK as a relation name.

Show
Pig includes a new RANK operator: RANK <relation> ( BY <column> (ASC|DES)? (DENSE)? )? This operator prepends a consecutive integer to each tuple in the relation starting from 1. If the BY clause is present, RANK sorts the relation before ranking it, otherwise it uses the order in which it receives the relation (e.g. the order in which the relation is stored if RANK is performed right after a LOAD). The DENSE modifier produces a dense rank, which has no gaps in it regardless of ties. RANK is now a reserved keyword and is *not* backward compatible. Please review your scripts to avoid usage of RANK as a relation name.

Implement a function that given a (sorted) bag adds to each tuple a unique, increasing identifier without gaps, like what RANK does for SQL.

This is a candidate project for Google summer of code 2012. More information about the program can be found at https://cwiki.apache.org/confluence/display/PIG/GSoc2012

incorporates

PIG-2989 Illustrate for Rank Operator

relates to

PIG-2922 Documentation and examples for RANK

supercedes

PIG-821 simulate NTILE(n) , rank() functionality in pig

There are no Sub-Tasks for this issue.