Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7947 Run impalad minicluster processes inside docker containers
  3. IMPALA-8392

make -j $IMPALA_BUILD_THREADS docker_images fails with OSError: [Errno 17] File exists: '/home/ubuntu/Impala/docker/build_context'

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: Impala 3.2.0
    • Fix Version/s: Impala 3.3.0
    • Component/s: Infrastructure
    • Labels:
      None

      Description

      Looks like there is a bug in the CMake file. I didn't see this with serial make or with ninja at all. I use ninja locally which is why I didn't notice this while developing it.

      02:45:52 Scanning dependencies of target catalogd_image
      02:45:52 Scanning dependencies of target coord_exec_image
      02:45:52 Scanning dependencies of target statestored_image
      02:45:52 Scanning dependencies of target coordinator_image
      02:45:52 Scanning dependencies of target executor_image
      02:45:52 [ 97%] Creating impala base build context.
      02:45:52 [ 97%] Creating impala base build context.
      02:45:52 [ 97%] Creating impala base build context.
      02:45:52 [ 98%] Creating impala base build context.
      02:45:52 [ 98%] Creating impala base build context.
      02:45:52 Traceback (most recent call last):
      02:45:52 Traceback (most recent call last):
      02:45:52 Traceback (most recent call last):
      02:45:52   File "./setup_build_context.py", line 38, in <module>
      02:45:52   File "./setup_build_context.py", line 38, in <module>
      02:45:52   File "./setup_build_context.py", line 38, in <module>
      02:45:52     os.makedirs(OUTPUT_DIR)
      02:45:52         os.makedirs(OUTPUT_DIR)
      02:45:52 os.makedirs(OUTPUT_DIR)
      02:45:52   File "/home/ubuntu/Impala/bin/../infra/python/env/lib/python2.7/os.py", line 157, in makedirs
      02:45:52   File "/home/ubuntu/Impala/bin/../infra/python/env/lib/python2.7/os.py", line 157, in makedirs
      02:45:52   File "/home/ubuntu/Impala/bin/../infra/python/env/lib/python2.7/os.py", line 157, in makedirs
      02:45:52         mkdir(name, mode)
      02:45:52 mkdir(name, mode)
      02:45:52     mkdir(name, mode)
      02:45:52 OSErrorOSErrorOSError: [Errno 17] File exists: '/home/ubuntu/Impala/docker/build_context'
      02:45:52 : [Errno 17] File exists: '/home/ubuntu/Impala/docker/build_context': 
      02:45:52 [Errno 17] File exists: '/home/ubuntu/Impala/docker/build_context'
      02:45:52 Traceback (most recent call last):
      02:45:52   File "./setup_build_context.py", line 60, in <module>
      02:45:52     symlink_file_into_dir(so, LIB_DIR)
      02:45:52   File "./setup_build_context.py", line 51, in symlink_file_into_dir
      02:45:52     os.symlink(src_file, os.path.join(dst_dir, os.path.basename(src_file)))
      02:45:52 OSError: [Errno 17] File exists
      02:45:52 docker/CMakeFiles/executor_image.dir/build.make:74: recipe for target 'docker/build_context/.timestamp' failed
      02:45:52 make[3]: *** [docker/build_context/.timestamp] Error 1
      02:45:52 docker/CMakeFiles/catalogd_image.dir/build.make:74: recipe for target 'docker/build_context/.timestamp' failed
      02:45:52 make[3]: *** [docker/build_context/.timestamp] Error 1
      02:45:52 CMakeFiles/Makefile2:13731: recipe for target 'docker/CMakeFiles/executor_image.dir/all' failed
      02:45:52 make[2]: *** [docker/CMakeFiles/executor_image.dir/all] Error 2
      02:45:52 make[2]: *** Waiting for unfinished jobs....
      02:45:52 CMakeFiles/Makefile2:13665: recipe for target 'docker/CMakeFiles/catalogd_image.dir/all' failed
      02:45:52 make[2]: *** [docker/CMakeFiles/catalogd_image.dir/all] Error 2
      02:45:52 docker/CMakeFiles/coordinator_image.dir/build.make:74: recipe for target 'docker/build_context/.timestamp' failed
      02:45:52 make[3]: *** [docker/build_context/.timestamp] Error 1
      02:45:52 docker/CMakeFiles/coord_exec_image.dir/build.make:74: recipe for target 'docker/build_context/.timestamp' failed
      02:45:52 make[3]: *** [docker/build_context/.timestamp] Error 1
      02:45:52 CMakeFiles/Makefile2:13797: recipe for target 'docker/CMakeFiles/coord_exec_image.dir/all' failed
      02:45:52 make[2]: *** [docker/CMakeFiles/coord_exec_image.dir/all] Error 2
      02:45:52 CMakeFiles/Makefile2:13764: recipe for target 'docker/CMakeFiles/coordinator_image.dir/all' failed
      02:45:52 make[2]: *** [docker/CMakeFiles/coordinator_image.dir/all] Error 2
      02:45:52 [ 98%] Building Impala base docker image.
      

      https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/33/

        Attachments

          Activity

            People

            • Assignee:
              tarmstrong Tim Armstrong
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: