[PIG-4574] Eliminate identity vertex for order by and skewed join right after LOAD - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.16.0
Component/s: tez
Labels:
None

Hadoop Flags:

Reviewed

Description

If ORDER BY or SKEWED JOIN is the operator immediately following LOAD+FOREACH without any FILTER, then data should be read again from HDFS for the partitioner vertex instead of writing to a identity vertex and reading from it.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

PIG-4574-1.patch
16/Jun/15 07:22
58 kB
Rohini Palaniswamy
PIG-4574-fix-testfailures.patch
02/Sep/15 05:02
4 kB
Rohini Palaniswamy

Issue Links

relates to

PIG-4915 Eliminate duplicate split calculation for Order by and Skewed Join

Open

Activity

People

Assignee:: Rohini Palaniswamy

Reporter:: Rohini Palaniswamy

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 26/May/15 17:44

Updated:: 08/Jun/16 20:48

Resolved:: 25/Jun/15 21:02