[HIVE-4770] Null Pointer Exception in Group By Operator

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: vectorization-branch
• Fix Version/s: vectorization-branch, 0.13.0
• Assignee: Jitendra Nath Pandey
• Reporter: Tony Murphy
• Created: 20/Jun/13 21:57
• Updated: 23/Oct/13 21:59
• Resolved: 05/Sep/13 20:36

Description

Table and data attached.

SELECT   cfloat,
         csmallint,
         cint,
         ctimestamp,
         (cfloat + 10),
         STDDEV_SAMP(cfloat),
         (-((cfloat + 10))),
         (cint / cfloat),
         MAX(cint),
         (-(cint)),
         (cint * STDDEV_SAMP(cfloat)),
         STDDEV_SAMP(cint),
         VAR_SAMP(cint),
         (-(MAX(cint))),
         ((-(MAX(cint))) / 0.00000000000000000000E+000)
FROM     alltypes_orc
WHERE    (((1 >= cfloat)
           OR (cstring2 LIKE '%b'))
          OR ((cint <= csmallint)
              OR (cstring2 LIKE '%ss')))
GROUP BY cfloat, csmallint, cint, ctimestamp
ORDER BY cint, cfloat;

java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"ctinyint":null,"csmallint":-3806,"cint":-66533315,"cbigint":null,"cdouble":null,"cfloat":152.95706,"cstring1":null,"cstring2":null,"ctimestamp":"9131-01-01 16:52:03.53","cboolean":null}
	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
	at org.apache.hadoop.mapred.Child.main(Child.java:265)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"ctinyint":null,"csmallint":-3806,"cint":-66533315,"cbigint":null,"cdouble":null,"cfloat":152.95706,"cstring1":null,"cstring2":null,"ctimestamp":"9131-01-01 16:52:03.53","cboolean":null}
	at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:671)
	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144)
	... 8 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:796)
	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
	at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:88)
	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
	at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:136)
	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
	at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)
	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
	at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:652)
	... 9 more
Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.shouldBeFlushed(GroupByOperator.java:941)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:836)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:723)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:791)
	... 21 more