[HIVE-11008] webhcat GET /jobs retries on getting job details from history server is too agressive

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.2.0
• Component/s: WebHCat
• Assignee: Thejas Nair
• Reporter: Thejas Nair
• Created: 15/Jun/15 19:45
• Updated: 29/Jul/15 20:29

Description

Webhcat "jobs" api gets the list of jobs from RM and then gets details from history server.

RM has a policy of retaining fixed number of jobs to accommodate for the memory it has, while HistoryServer retains jobs based on their age. As a result, jobs that RM returns might not be present in HistoryServer and can result in a failure. HistoryServer also ends up retrying on failures even if they happen because the job actually does not exist.
The retries to get details from HistoryServer in such cases is too aggressive.

Issue Links

• mentioned in: Wiki Page Loading...