[HCATALOG-587] webhcat controller map task takes too much memory

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5
• Component/s: webhcat-svr
• Assignee: Thejas Nair
• Reporter: Thejas Nair
• Created: 08/Jan/13 03:20
• Updated: 15/Feb/13 21:32
• Resolved: 17/Jan/13 18:23

Description

The webhcat map only task does not need lot of memory. But when a java application is started with -server option, it allocates the memory specified as max heap size (-Xmx in oracle jre) upfront.
When combined with the memory used by pig or hive client, this can sometimes exceed the maximum memory limit for a map task (if configured).
Being able to specify the java options for the map task will be useful to avoid this issue.

Issue Links

• relates to: HCATALOG-597 improve AppConfig so values can only be retrieved one way