Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3140

Auto merge jobs should not block user build jobs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • None
    • Backlog
    • Job Engine
    • None

    Description

      Although in the latest version, Kylin support concurrent jobs. If the concurrency is set to 1, there is some possibility that cube build job will have dead lock. Say, when there is some issue which causes merge job failed, even when you discard the job, another job will be launched and failed again due to auto merge policy. And this failed merge job blocks user to build incremental segment.
      Even if the concurrency is set to larger than 1, the auto merge jobs occupy some concurrency quota.

      While, from user perspective, they don't care much about the auto merge jobs, and the auto merge jobs should not block the building/refresh jobs they submit manually.
      A better way may be separating the auto merge jobs from the job queue, parameter max-building-segments only limit jobs submitted by users.

      Attachments

        Activity

          People

            shaofengshi Shao Feng Shi
            gwang3 Wang, Gang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: