Uploaded image for project: 'Apache Gobblin'
  1. Apache Gobblin
  2. GOBBLIN-308

Gobblin cluster bootup hangs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • None
    • None

    Description

      The problem happens when there are more than 100 files in the job catalog. During the boot up sequence, spec consumer was launched after jobCatalog. However the jobCatalog launches with a job listener which will push job spec into a blocking queue, and due to spec consumer hasn't been started, no component will start to consume job specs from the blocking queue. Once the blocking queue max size (100 by default) is reached, the system is hanging.

      Attachments

        Activity

          People

            yukuai518 Kuai Yu
            yukuai518 Kuai Yu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: