[KYLIN-1785] NoSuchElementException when Mandatory Dimensions contains all Dimensions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: v1.5.1, v1.5.2
• Fix Version/s: v1.5.3
• Assignee: Hongbin Ma
• Reporter: Guohui LI
• Created: 14/Jun/16 13:15
• Updated: 08/Aug/16 13:55
• Resolved: 18/Jul/16 12:45

Description

When Mandatory Dimensions included all dimensions in the Aggregation Groups, NoSuchElementException will thrown in Build N-Dimension Cuboid Data step(or Build Cube steps if in-mem cubing):

2016-06-13 11:46:13,842 INFO [main] org.apache.kylin.dict.DictionaryManager: DictionaryManager(1419528284) loading DictionaryInfo(loadDictObj:true) at /dict/FUJIAN.HTTP_10T_PARTITION/MODEL_NAME/a1437b13-e7f6-49dc-bad7-232f80535f9a.dict
2016-06-13 11:46:13,847 INFO [main] org.apache.hadoop.mapred.MapTask: Starting flush of map output
2016-06-13 11:46:13,918 INFO [main] org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor [.snappy]
2016-06-13 11:46:14,895 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.util.NoSuchElementException
	at java.util.ArrayList$Itr.next(ArrayList.java:834)
	at java.util.Collections.min(Collections.java:665)
	at org.apache.kylin.cube.cuboid.Cuboid.translateToValidCuboid(Cuboid.java:201)
	at org.apache.kylin.cube.cuboid.Cuboid.translateToValidCuboid(Cuboid.java:125)
	at org.apache.kylin.cube.cuboid.Cuboid.findById(Cuboid.java:67)
	at org.apache.kylin.engine.mr.steps.NDCuboidMapper.map(NDCuboidMapper.java:148)
	at org.apache.kylin.engine.mr.steps.NDCuboidMapper.map(NDCuboidMapper.java:49)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1793)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2016-06-13 11:46:15,934 INFO [main] org.apache.hadoop.mapred.Task: Runnning cleanup for the task

Issue Links

• is related to: KYLIN-1945 Cuboid.translateToValidCuboid method throw exception while cube building or query execute
• relates to: KYLIN-1788 Allow arbitrary number of mandatory dimensions in one aggregation group