[HIVE-4913] Put deterministic ordering in the top-K ngrams output of UDF context_ngrams()

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.10.0, 0.11.0
• Fix Version/s: 0.12.0
• Component/s: UDF
• Assignee: Xuefu Zhang
• Reporter: Xuefu Zhang
• Created: 22/Jul/13 22:39
• Updated: 15/Oct/13 23:29
• Resolved: 10/Aug/13 09:51

Description

Currently UDF context_ngrams() output top-K ngrams in the order of descending frequency. When there are ties, i.e., phrases with same ngram value, the order is indeterministic. Tie breaker is needed to break the ties, so that the output is deterministic.

Issue Links

• is depended upon by: HIVE-4583 Make Hive compile and run with JDK7
• links to: Review board request