[BEAM-7405] Task :sdks:python:hdfsIntegrationTest is failing in Python PostCommits - docker-credential-gcloud not installed

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.14.0
• Component/s: test-failures
• Labels: stale-assigned
• Assignee: Udi Meiri
• Reporter: Valentyn Tymofieiev
• Created: 23/May/19 16:24
• Updated: 04/Jun/20 16:29
• Resolved: 02/Jun/20 18:22

Description

This failure happened on apache-beam-jenkins-14.

18:47:03 > Task :sdks:python:hdfsIntegrationTest
18:47:03 ++ dirname ./apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh
18:47:03 + TEST_DIR=./apache_beam/io/hdfs_integration_test
18:47:03 + ROOT_DIR=./apache_beam/io/hdfs_integration_test/../../../../..
18:47:03 + CONTEXT_DIR=./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
18:47:03 + rm -r ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
18:47:03 rm: cannot remove './apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration': No such file or directory
18:47:03 + true
18:47:03 + mkdir -p ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/sdks
18:47:03 + cp ./apache_beam/io/hdfs_integration_test/docker-compose.yml ./apache_beam/io/hdfs_integration_test/Dockerfile ./apache_beam/io/hdfs_integration_test/hdfscli.cfg ./apache_beam/io/hdfs_integration_test/hdfs_integration_test.sh ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/
18:47:03 + cp -r ./apache_beam/io/hdfs_integration_test/../../../../../sdks/python ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/sdks/
18:47:03 + cp -r ./apache_beam/io/hdfs_integration_test/../../../../../model ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration/
18:47:03 ++ echo hdfs_IT-jenkins-beam_PostCommit_Python_Verify_PR-714
18:47:03 + PROJECT_NAME=hdfs_IT-jenkins-beam_PostCommit_Python_Verify_PR-714
18:47:03 + '[' -z jenkins-beam_PostCommit_Python_Verify_PR-714 ']'
18:47:03 + COLOR_OPT=--no-ansi
18:47:03 + COMPOSE_OPT='-p hdfs_IT-jenkins-beam_PostCommit_Python_Verify_PR-714 --no-ansi'
18:47:03 + cd ./apache_beam/io/hdfs_integration_test/../../../../../build/hdfs_integration
18:47:03 + docker network prune --force
18:47:03 + trap finally EXIT
18:47:03 + docker-compose -p hdfs_IT-jenkins-beam_PostCommit_Python_Verify_PR-714 --no-ansi build
18:47:03 namenode uses an image, skipping
18:47:03 datanode uses an image, skipping
18:47:03 Building test
18:47:03 [29234] Failed to execute script docker-compose
18:47:03 Traceback (most recent call last):
18:47:03   File "bin/docker-compose", line 6, in <module>
18:47:03   File "compose/cli/main.py", line 71, in main
18:47:03   File "compose/cli/main.py", line 127, in perform_command
18:47:03   File "compose/cli/main.py", line 287, in build
18:47:03   File "compose/project.py", line 386, in build
18:47:03   File "compose/project.py", line 368, in build_service
18:47:03   File "compose/service.py", line 1084, in build
18:47:03   File "site-packages/docker/api/build.py", line 260, in build
18:47:03   File "site-packages/docker/api/build.py", line 307, in _set_auth_headers
18:47:03   File "site-packages/docker/auth.py", line 310, in get_all_credentials
18:47:03   File "site-packages/docker/auth.py", line 262, in _resolve_authconfig_credstore
18:47:03   File "site-packages/docker/auth.py", line 287, in _get_store_instance
18:47:03   File "site-packages/dockerpycreds/store.py", line 25, in __init__
18:47:03 dockerpycreds.errors.InitializationError: docker-credential-gcloud not installed or not available in PATH

Issue Links

• links to: GitHub Pull Request #8666
• links to: GitHub Pull Request #8669