[FLINK-32107] Kubernetes test failed because ofunable to establish ssl connection to github on AZP

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.18.0, 1.17.1
• Fix Version/s: 1.17.2, 1.19.0, 1.18.1
• Component/s: Tests
• Labels: pull-request-available starter test-stability
• Assignee: xiang1 yu
• Reporter: Sergey Nuyanzin
• Created: 16/May/23 07:28
• Updated: 02/Nov/23 01:04
• Resolved: 01/Nov/23 12:45

Description

on AZP kubernetes test fails https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=49022&view=logs&j=bea52777-eaf8-5663-8482-18fbc3630e81&t=43ba8ce7-ebbf-57cd-9163-444305d74117&l=4884
as

2023-05-16T03:54:54.4652330Z May 16 03:54:54 
2023-05-16T03:54:54.4652942Z May 16 03:54:54 [FAIL] 'Run Kubernetes test' failed after 5 minutes and 37 seconds! Test exited with exit code 1
2023-05-16T03:54:54.4653363Z May 16 03:54:54 

in logs

023-05-16T03:49:29.2350048Z --2023-05-16 03:49:29--  https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.24.2/crictl-v1.24.2-linux-amd64.tar.gz
2023-05-16T03:49:29.2401348Z Resolving github.com (github.com)... 140.82.121.3
2023-05-16T03:49:29.2519421Z Connecting to github.com (github.com)|140.82.121.3|:443... connected.
2023-05-16T03:49:29.2636971Z Unable to establish SSL connection.
2023-05-16T03:49:29.2717345Z tar (child): crictl-v1.24.2-linux-amd64.tar.gz: Cannot open: No such file or directory
2023-05-16T03:49:29.2718128Z tar (child): Error is not recoverable: exiting now
2023-05-16T03:49:29.2720740Z tar: Child returned status 2
2023-05-16T03:49:29.2721169Z tar: Error is not recoverable: exiting now

and then

2023-05-16T03:51:19.7583853Z May 16 03:51:19 Starting minikube ...
2023-05-16T03:51:19.8445449Z May 16 03:51:19 * minikube v1.28.0 on Ubuntu 20.04
2023-05-16T03:51:19.8459453Z May 16 03:51:19 * Using the none driver based on user configuration
2023-05-16T03:51:19.8479317Z May 16 03:51:19 * Starting control plane node minikube in cluster minikube
2023-05-16T03:51:19.8500624Z May 16 03:51:19 * Running on localhost (CPUs=2, Memory=6943MB, Disk=85160MB) ...
2023-05-16T03:51:19.8773352Z May 16 03:51:19 * minikube 1.30.1 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.30.1
2023-05-16T03:51:19.8784220Z May 16 03:51:19 * To disable this notice, run: 'minikube config set WantUpdateNotification false'
2023-05-16T03:51:19.8784716Z May 16 03:51:19 
2023-05-16T03:51:20.3656967Z May 16 03:51:20 * OS release is Ubuntu 20.04.6 LTS
2023-05-16T03:52:21.7634993Z May 16 03:52:21 
2023-05-16T03:52:21.7654050Z X Exiting due to RUNTIME_ENABLE: Temporary Error: sudo crictl version: exit status 1
2023-05-16T03:52:21.7654511Z stdout:
2023-05-16T03:52:21.7654700Z 
2023-05-16T03:52:21.7654925Z stderr:
2023-05-16T03:52:21.7655194Z sudo: crictl: command not found
2023-05-16T03:52:21.7655377Z 
2023-05-16T03:52:21.7655589Z * 
2023-05-16T03:52:21.7676462Z ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
2023-05-16T03:52:21.7677189Z │                                                                                             │
2023-05-16T03:52:21.7677684Z │    * If the above advice does not help, please let us know:                                 │
2023-05-16T03:52:21.7678141Z │      https://github.com/kubernetes/minikube/issues/new/choose                               │
2023-05-16T03:52:21.7678549Z │                                                                                             │
2023-05-16T03:52:21.7679208Z │    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
2023-05-16T03:52:21.7679781Z │                                                                                             │
2023-05-16T03:52:21.7680268Z ╰─────────────────────────────────────────────────────────────────────────────────────────────╯
2023-05-16T03:52:21.7680606Z May 16 03:52:21 
2023-05-16T03:52:21.8422493Z E0516 03:52:21.841334  243032 root.go:80] failed to log command start to audit: failed to open the audit log: open /home/vsts/.minikube/logs/audit.json: permission denied
2023-05-16T03:52:21.8434631Z May 16 03:52:21 
2023-05-16T03:52:21.8447806Z X Exiting due to HOST_HOME_PERMISSION: open /home/vsts/.minikube/profiles/minikube/config.json: permission denied
2023-05-16T03:52:21.8448801Z * Suggestion: Your user lacks permissions to the minikube profile directory. Run: 'sudo chown -R $USER $HOME/.minikube; chmod -R u+wrx $HOME/.minikube' to fix
2023-05-16T03:52:21.8449545Z * Related issue: https://github.com/kubernetes/minikube/issues/9165
2023-05-16T03:52:21.8458468Z May 16 03:52:21 
2023-05-16T03:52:21.9310476Z May 16 03:52:21 
2023-05-16T03:52:21.9317664Z X Exiting due to HOST_HOME_PERMISSION: open /home/vsts/.minikube/profiles/minikube/config.json: permission denied
2023-05-16T03:52:21.9318812Z * Suggestion: Your user lacks permissions to the minikube profile directory. Run: 'sudo chown -R $USER $HOME/.minikube; chmod -R u+wrx $HOME/.minikube' to fix
2023-05-16T03:52:21.9319960Z * Related issue: https://github.com/kubernetes/minikube/issues/9165
2023-05-16T03:52:21.9324395Z May 16 03:52:21 
2023-05-16T03:52:21.9348539Z May 16 03:52:21 Command: start_kubernetes_if_not_running failed. Retrying...
2023-05-16T03:52:27.0051571Z May 16 03:52:26 
2023-05-16T03:52:27.0056411Z X Exiting due to HOST_HOME_PERMISSION: open /home/vsts/.minikube/profiles/minikube/config.json: permission denied
2023-05-16T03:52:27.0058550Z * Suggestion: Your user lacks permissions to the minikube profile directory. Run: 'sudo chown -R $USER $HOME/.minikube; chmod -R u+wrx $HOME/.minikube' to fix
2023-05-16T03:52:27.0059468Z * Related issue: https://github.com/kubernetes/minikube/issues/9165

Issue Links

• relates to: FLINK-29671 Kubernetes e2e test fails during test initialization
• links to: GitHub Pull Request #23528