[HIVE-12424] Make use of Kryo's Object-to-Object deep copy

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0
• Component/s: Serializers/Deserializers
• Assignee: Prasanth Jayachandran
• Reporter: Prasanth Jayachandran
• Created: 16/Nov/15 21:59
• Updated: 10/Dec/15 21:44

Description

Currently, plan serialization and operator tree serialization uses Object -> bytes -> Object approach for deep copy. It also uses ByteArrayOutputStream as intermediate buffer whose write method is synchronized. Similarly read from ByteArrayInputStream is also synchronized. Also Utilities.clonePlan() creates a new HiveConf object that scans through conf directories and adds site.xml which is an expensive operation. All these can be avoided using Kryo's Object -> Object deep copy.

Issue Links

• links to: Kryo PR