Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-5283

LinuxFilesystemIsolatorTest.ROOT_VolumeFromSandbox is flaky.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: test
    • Environment:

      CentOS 7 without SSL

    • Epic Link:
    • Sprint:
      Mesosphere Sprint 37

      Description

      Observed on the internal Mesosphere CI:

      [23:10:03] :	 [Step 10/10] [ RUN      ] LinuxFilesystemIsolatorTest.ROOT_VolumeFromSandbox
      [23:10:05]W:	 [Step 10/10] I0425 23:10:05.061769 32151 linux.cpp:81] Making '/mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC' a shared mount
      [23:10:05]W:	 [Step 10/10] I0425 23:10:05.074729 32151 linux_launcher.cpp:101] Using /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher
      [23:10:05]W:	 [Step 10/10] I0425 23:10:05.075099 32170 containerizer.cpp:703] Starting container '14a48c04-9157-4796-8743-f37ad5da05d1' for executor 'test_executor' of framework ''
      [23:10:05]W:	 [Step 10/10] I0425 23:10:05.075275 32168 provisioner.cpp:285] Provisioning image rootfs '/mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC/provisioner/containers/14a48c04-9157-4796-8743-f37ad5da05d1/backends/copy/rootfses/f47a2ca8-b8bc-4bfa-bfaf-788c2eb33b49' for container 14a48c04-9157-4796-8743-f37ad5da05d1
      [23:10:05]W:	 [Step 10/10] I0425 23:10:05.075589 32166 copy.cpp:128] Copying layer path '/tmp/uK310o/test_image' to rootfs '/mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC/provisioner/containers/14a48c04-9157-4796-8743-f37ad5da05d1/backends/copy/rootfses/f47a2ca8-b8bc-4bfa-bfaf-788c2eb33b49'
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.184612 32165 linux.cpp:355] Bind mounting work directory from '/tmp/uK310o/sandbox' to '/mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC/provisioner/containers/14a48c04-9157-4796-8743-f37ad5da05d1/backends/copy/rootfses/f47a2ca8-b8bc-4bfa-bfaf-788c2eb33b49/mnt/mesos/sandbox' for container 14a48c04-9157-4796-8743-f37ad5da05d1
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.185264 32167 linux_launcher.cpp:281] Cloning child process with flags = CLONE_NEWNS
      [23:10:09]W:	 [Step 10/10] + /mnt/teamcity/work/4240ba9ddd0997c3/build/src/mesos-containerizer mount --help=false --operation=make-rslave --path=/
      [23:10:09]W:	 [Step 10/10] + grep -E /mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC/.+ /proc/self/mountinfo
      [23:10:09]W:	 [Step 10/10] + grep -v 14a48c04-9157-4796-8743-f37ad5da05d1
      [23:10:09]W:	 [Step 10/10] + cut '-d ' -f5
      [23:10:09]W:	 [Step 10/10] + xargs --no-run-if-empty umount -l
      [23:10:09]W:	 [Step 10/10] + mount -n --rbind /tmp/uK310o/sandbox/tmp /mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC/provisioner/containers/14a48c04-9157-4796-8743-f37ad5da05d1/backends/copy/rootfses/f47a2ca8-b8bc-4bfa-bfaf-788c2eb33b49/tmp
      [23:10:09] :	 [Step 10/10] Changing root to /mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC/provisioner/containers/14a48c04-9157-4796-8743-f37ad5da05d1/backends/copy/rootfses/f47a2ca8-b8bc-4bfa-bfaf-788c2eb33b49
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.284610 32170 containerizer.cpp:1717] Executor for container '14a48c04-9157-4796-8743-f37ad5da05d1' has exited
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.284638 32170 containerizer.cpp:1481] Destroying container '14a48c04-9157-4796-8743-f37ad5da05d1'
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.286339 32172 cgroups.cpp:2676] Freezing cgroup /sys/fs/cgroup/freezer/mesos/14a48c04-9157-4796-8743-f37ad5da05d1
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.287952 32169 cgroups.cpp:1409] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/14a48c04-9157-4796-8743-f37ad5da05d1 after 1.587712ms
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.289566 32171 cgroups.cpp:2694] Thawing cgroup /sys/fs/cgroup/freezer/mesos/14a48c04-9157-4796-8743-f37ad5da05d1
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.290956 32171 cgroups.cpp:1438] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/14a48c04-9157-4796-8743-f37ad5da05d1 after 1.371904ms
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.292289 32167 linux.cpp:825] Unmounting sandbox/work directory '/mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC/provisioner/containers/14a48c04-9157-4796-8743-f37ad5da05d1/backends/copy/rootfses/f47a2ca8-b8bc-4bfa-bfaf-788c2eb33b49/mnt/mesos/sandbox' for container 14a48c04-9157-4796-8743-f37ad5da05d1
      [23:10:09]W:	 [Step 10/10] I0425 23:10:09.292472 32169 provisioner.cpp:338] Destroying container rootfs at '/mnt/teamcity/temp/buildTmp/LinuxFilesystemIsolatorTest_ROOT_VolumeFromSandbox_vndkVC/provisioner/containers/14a48c04-9157-4796-8743-f37ad5da05d1/backends/copy/rootfses/f47a2ca8-b8bc-4bfa-bfaf-788c2eb33b49' for container 14a48c04-9157-4796-8743-f37ad5da05d1
      [23:10:24] :	 [Step 10/10] ../../src/tests/containerizer/filesystem_isolator_tests.cpp:855: Failure
      [23:10:24] :	 [Step 10/10] Failed to wait 15secs for wait
      [23:10:24] :	 [Step 10/10] [  FAILED  ] LinuxFilesystemIsolatorTest.ROOT_VolumeFromSandbox (21434 ms)
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gilbert Gilbert Song
                Reporter:
                gilbert Gilbert Song
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: