[PIG-4874] Remove schema tuple reference overhead for replicate join hashmap - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.16.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Currently even if pig.schematuple is set to false which is the default, the usage of TupleToMapKey and TuplesToSchemaTupleList instead of plain HashMap<Object, ArrayList<Tuple>> costs a lot of memory. Also key is currently converted to a tuple which is unnecessary.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

PIG-4874-2.patch
19/Apr/16 22:13
23 kB
Rohini Palaniswamy
PIG-4874-1.patch
18/Apr/16 04:00
23 kB
Rohini Palaniswamy

Issue Links

relates to

PIG-4875 Fix SchemaTuple for Tez

Open

Activity

People

Assignee:: Rohini Palaniswamy

Reporter:: Rohini Palaniswamy

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 18/Apr/16 03:42

Updated:: 08/Jun/16 20:48

Resolved:: 12/May/16 21:05