[HIVE-1511] Hive plan serialization is slow

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0, 0.11.0
• Fix Version/s: 0.13.0
• Labels: TODOC13
• Hadoop Flags: Incompatible change
• Release Note: Any 3rd party UDFs used must be declared as public classes.
• Assignee: Mohammad Islam
• Reporter: Ning Zhang
• Created: 04/Aug/10 18:08
• Updated: 05/Jul/14 08:08
• Resolved: 09/Sep/13 13:58

Description

As reported by Edward Capriolo:

For reference I did this as a test case....
SELECT * FROM src where
key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0
OR key=0 OR key=0 OR key=0 OR
key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0
OR key=0 OR key=0 OR key=0 OR
...(100 more of these)

No OOM but I gave up after the test case did not go anywhere for about
2 minutes.

Issue Links

• breaks: HIVE-6005 BETWEEN is broken after using KRYO
• breaks: HIVE-5257 Add kryo into eclipse template
• is related to: HIVE-5064 TestParse fails on JDK7
• is related to: HIVE-5263 Query Plan cloning time could be improved by using Kryo
• relates to: HIVE-4885 Alternative object serialization for execution plan in hive testing