[PIG-5192] Remove schema tuple reference overhead for replicate join hashmap in POFRJoinSpark

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: spark-branch
• Component/s: spark
• Assignee: Unassigned
• Reporter: liyunzhang
• Created: 16/Mar/17 21:50
• Updated: 16/Mar/17 21:51

Description

Currently even if pig.schematuple is set to false which is the default, the usage of TupleToMapKey and TuplesToSchemaTupleList instead of plain HashMap<Object, ArrayList<Tuple>> costs a lot of memory. Also key is currently converted to a tuple which is unnecessary. Detail see PIG-4874