Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1696

Resource calculator should consider the requested disk resource at the first stage

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: Resource Manager
    • Labels:
      None

      Description

      Resource calculator currently considers only cpu and memory. However, disk is an important resource in the first stage, so should be considered for available resource calculation.

      In addition, in the current implementation, a worker sends a heartbeat whenever it finishes processing half of the assigned tasks. So, the problem of ignoring disk resource makes the first heartbeat delayed during the first stage, thereby making the query execution slow.

        Attachments

          Activity

            People

            • Assignee:
              jihoonson Jihoon Son
              Reporter:
              jihoonson Jihoon Son
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: