Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-9221

If some image layers are large, the image pulling may stuck due to the authorized token expired.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.4.2, 1.5.0
    • Fix Version/s: None
    • Component/s: containerization
    • Labels:

      Description

      The image layer blobs pulling happen asynchronously but in the same libprocess process. There is a chance that one layer get the token then the thread switch to another layer curling which may take long. When the original layer curling resumes, the token already expired (e.g., after 60 seconds).

      $ sudo cat /var/lib/mesos/slave/store/docker/staging/0gx64f/sha256\:c75480ad9aafadef6c7faf829ede40cf2fa990c9308d6cd354d53041b01a7cda
      {"errors":[{"code":"UNAUTHORIZED","message":"authentication required","detail":[{"Type":"repository","Class":"","Name":"mesosphere/dapis","Action":"pull"}]}]}
      

      The impact is the task launch stuck and all subsequent task using this image would also stuck because it waits for the same image pulling future to become ready.

      Please note that this issue is not likely to be reproduced, unless on a busy system using images containing large layers.

        Attachments

        1. nginx_registry.conf
          1 kB
          Chun-Hung Hsiao
        2. mesos-task.json
          0.7 kB
          Chun-Hung Hsiao

          Issue Links

            Activity

              People

              • Assignee:
                chhsia0 Chun-Hung Hsiao
                Reporter:
                gilbert Gilbert Song
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: