[HIVE-222] Group by on a combination of disitinct and non distinct aggregates can return serialization errors with map side aggregations. - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Bulk Copy Attachments

Bulk Move Attachments

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Move

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.3.0
Component/s: Query Processor
Labels:
None

Hadoop Flags:

Reviewed
Release Note:

Hide
~~HIVE-222~~. Fixed Group by on a combination of disitinct and non distinct aggregates. (Ashish Thusoo via zshao)

Show
HIVE-222 . Fixed Group by on a combination of disitinct and non distinct aggregates. (Ashish Thusoo via zshao)

Description

For queries of the form (groupby2_map.q in the source)

SELECT x, count(DISTINCT y), SUM FROM t GROUP BY x

when map side aggregation is on

hive.map.aggr=true (This is off by default)

The following exception can occur:
[junit] Caused by: java.lang.ClassCastException: java.lang.Long cannot be cast to java.lang.Double
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDeTypeDouble.serialize(DynamicSerDeTypeDouble.java:60)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDeFieldList.serialize(DynamicSerDeFieldList.java:235)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDeStructBase.serialize(DynamicSerDeStructBase.java:81)
[junit] at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.serialize(DynamicSerDe.java:174)