[TAJO-1696] Resource calculator should consider the requested disk resource at the first stage

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Component/s: Resource Manager
• Assignee: Jihoon Son
• Reporter: Jihoon Son
• Created: 22/Jul/15 02:46
• Updated: 04/Aug/15 01:31
• Resolved: 04/Aug/15 01:30

Description

Resource calculator currently considers only cpu and memory. However, disk is an important resource in the first stage, so should be considered for available resource calculation.

In addition, in the current implementation, a worker sends a heartbeat whenever it finishes processing half of the assigned tasks. So, the problem of ignoring disk resource makes the first heartbeat delayed during the first stage, thereby making the query execution slow.