[HIVE-11156] LLAP: Cache arena size rounding

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: llap
• Fix Version/s: llap
• Assignee: Sergey Shelukhin
• Reporter: Gopal Vijayaraghavan
• Created: 01/Jul/15 00:59
• Updated: 17/Feb/16 01:33
• Resolved: 01/Jul/15 23:52

Description

LLAP buddy allocator doesn't like the large cache size (64Gb) in combination with the rest of the default configs

2015-06-30 20:56:01,401 [main()] WARN org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon: Failed to start LLAP Daemon with exception
java.lang.RuntimeException: Failed to create impl class
	at org.apache.hadoop.hive.llap.io.api.LlapIoProxy.createIoImpl(LlapIoProxy.java:69)
	at org.apache.hadoop.hive.llap.io.api.LlapIoProxy.initializeLlapIo(LlapIoProxy.java:55)
	at org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon.serviceInit(LlapDaemon.java:231)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon.main(LlapDaemon.java:298)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
	at org.apache.hadoop.hive.llap.io.api.LlapIoProxy.createIoImpl(LlapIoProxy.java:67)
	... 4 more
Caused by: java.lang.AssertionError: Cache size not consistent with arena size: 134217728,68729962496
	at org.apache.hadoop.hive.llap.cache.BuddyAllocator.<init>(BuddyAllocator.java:71)
	at org.apache.hadoop.hive.llap.io.api.impl.LlapIoImpl.<init>(LlapIoImpl.java:100)
	... 9 more