[PROTON-2282] Flakines in python-integration-test test - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: proton-c-0.32.0
Fix Version/s: None
Component/s: python-binding
Labels:
None

Description

https://github.com/jiridanek/qpid-proton/runs/1205657822#step:13:2817

 test 33
      Start 33: python-integration-test

33: Test command: /opt/hostedtoolcache/Python/3.6.12/x64/bin/python "/home/runner/work/qpid-proton/qpid-proton/scripts/env.py" "--" "PATH=/home/runner/work/qpid-proton/qpid-proton/BLD/c/tools:/home/runner/work/qpid-proton/qpid-proton/BLD/c:/opt/hostedtoolcache/Python/3.6.12/x64/bin:/opt/hostedtoolcache/Python/3.6.12/x64:/home/linuxbrew/.linuxbrew/bin:/home/linuxbrew/.linuxbrew/sbin:/usr/share/rust/.cargo/bin:/home/runner/.config/composer/vendor/bin:/home/runner/.dotnet/tools:/snap/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin" "PYTHONPATH=/home/runner/work/qpid-proton/qpid-proton/python/tests:/home/runner/work/qpid-proton/qpid-proton/python:/home/runner/work/qpid-proton/qpid-proton/BLD/python:/home/runner/work/qpid-proton/qpid-proton/BLD/python:/home/runner/work/qpid-proton/qpid-proton/python/../tests/py" "SASLPASSWD=CyrusSASL_Saslpasswd_EXECUTABLE-NOTFOUND" "/opt/hostedtoolcache/Python/3.6.12/x64/bin/python" "-m" "unittest" "discover" "-v" "-s" "/home/runner/work/qpid-proton/qpid-proton/python/tests/integration"
33: Test timeout computed to be: 1500
33: test_application_event_no_object_leaks (test_PROTON_1709_application_event_object_leak.Proton1709Test) ... ok
33: test_sync_request_response_blocking_connection_no_fd_leaks (test_PROTON_1800_syncrequestresponse_fd_leak.Proton1800Test) ... ok
33: test_send_message_ssl_no_object_leaks (test_PROTON_2111_container_ssl_ssldomain_object_leak.Proton2111Test)
33: Starts a broker with ssl acceptor, in a loop connects to it and sends message. ... ok
33: test_blocking_connection_object_leak (test_PROTON_2116_blocking_connection_object_leak.Proton2116Test)
33: Kills and restarts broker repeatedly, while client is reconnecting. ... ok
33: test_connection_close_all (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... total 0
33: lr-x------ 1 runner docker 64 Oct  4 15:13 0 -> pipe:[62490]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 1 -> pipe:[66364]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 2 -> pipe:[66364]
33: lr-x------ 1 runner docker 64 Oct  4 15:13 3 -> pipe:[67233]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 4 -> pipe:[67233]
33: lrwx------ 1 runner docker 64 Oct  4 15:13 5 -> socket:[66391]
33: lrwx------ 1 runner docker 64 Oct  4 15:13 6 -> socket:[68957]
33: expected failure
33: test_connection_close_all__do_not_check_test_broker (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... FAIL
33: test_connection_receiver_close_all (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... total 0
33: lr-x------ 1 runner docker 64 Oct  4 15:13 0 -> pipe:[62490]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 1 -> pipe:[66364]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 2 -> pipe:[66364]
33: lr-x------ 1 runner docker 64 Oct  4 15:13 3 -> pipe:[67233]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 4 -> pipe:[67233]
33: lrwx------ 1 runner docker 64 Oct  4 15:13 5 -> socket:[66391]
33: lrwx------ 1 runner docker 64 Oct  4 15:13 6 -> socket:[68972]
33: lrwx------ 1 runner docker 64 Oct  4 15:14 7 -> socket:[68137]
33: lrwx------ 1 runner docker 64 Oct  4 15:14 8 -> socket:[68142]
33: expected failure
33: test_connection_sender_close_all (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... total 0
33: lr-x------ 1 runner docker 64 Oct  4 15:13 0 -> pipe:[62490]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 1 -> pipe:[66364]
33: lrwx------ 1 runner docker 64 Oct  4 15:13 10 -> socket:[68152]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 2 -> pipe:[66364]
33: lr-x------ 1 runner docker 64 Oct  4 15:13 3 -> pipe:[67233]
33: l-wx------ 1 runner docker 64 Oct  4 15:13 4 -> pipe:[67233]
33: lrwx------ 1 runner docker 64 Oct  4 15:13 5 -> socket:[66391]
33: lrwx------ 1 runner docker 64 Oct  4 15:14 7 -> socket:[68137]
33: lrwx------ 1 runner docker 64 Oct  4 15:14 8 -> socket:[68142]
33: lrwx------ 1 runner docker 64 Oct  4 15:14 9 -> socket:[68994]
33: expected failure
33: test_just_start_stop_test_broker (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... expected failure
33: 
33: ======================================================================
33: FAIL: test_connection_close_all__do_not_check_test_broker (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests)
33: ----------------------------------------------------------------------
33: Traceback (most recent call last):
33:   File "/home/runner/work/qpid-proton/qpid-proton/python/tests/integration/test_PROTON_2121_blocking_connection_fd_leak.py", line 141, in test_connection_close_all__do_not_check_test_broker
33:     gc.collect()
33:   File "/opt/hostedtoolcache/Python/3.6.12/x64/lib/python3.6/contextlib.py", line 88, in __exit__
33:     next(self.gen)
33:   File "/home/runner/work/qpid-proton/qpid-proton/python/tests/integration/test_PROTON_2121_blocking_connection_fd_leak.py", line 62, in no_fd_leaks
33:     test.fail([w.message for w in ws])
33: AssertionError: [ResourceWarning("unclosed <socket.socket fd=6, family=AddressFamily.AF_INET, type=2049, proto=0, laddr=('127.0.0.1', 45591)>",)]
33: 
33: ----------------------------------------------------------------------
33: Ran 9 tests in 19.906s
33: 
33: FAILED (failures=1, expected failures=4)
33/51 Test #33: python-integration-test ..........***Failed   23.22 sec

Different issue, in the same test

test 29
      Start 29: python-integration-test

29: Test command: /usr/bin/python "/foo/proton/scripts/env.py" "--" "PATH=/foo/proton/build/c/tools:/foo/proton/build/c:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin" "PYTHONPATH=/foo/proton/python/tests:/foo/proton/python:/foo/proton/build/python:/foo/proton/build/python:/foo/proton/python/../tests/py" "SASLPASSWD=/usr/sbin/saslpasswd2" "TEST_EXE_PREFIX=/usr/bin/valgrind --tool=memcheck --leak-check=full --error-exitcode=42 --quiet --suppressions=/foo/proton/tests/valgrind.supp" "/usr/bin/python" "-m" "unittest" "discover" "-v" "-s" "/foo/proton/python/tests/integration"
29: Test timeout computed to be: 1500
29: test_application_event_no_object_leaks (test_PROTON_1709_application_event_object_leak.Proton1709Test) ... ok
29: test_sync_request_response_blocking_connection_no_fd_leaks (test_PROTON_1800_syncrequestresponse_fd_leak.Proton1800Test) ... total 0
29: lr-x------. 1 root root 64 Oct  1 08:07 0 -> pipe:[156586561]
29: l-wx------. 1 root root 64 Oct  1 08:07 1 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 10 -> /dev/urandom
29: lr-x------. 1 root root 64 Oct  1 08:07 12 -> /dev/urandom
29: l-wx------. 1 root root 64 Oct  1 08:07 2 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 3 -> pipe:[156674097]
29: l-wx------. 1 root root 64 Oct  1 08:07 4 -> /foo/proton/build/Testing/Temporary/LastTest_20201001-0804.log.tmp
29: l-wx------. 1 root root 64 Oct  1 08:07 5 -> pipe:[156674097]
29: lrwx------. 1 root root 64 Oct  1 08:07 6 -> socket:[156671465]
29: skipped "Test failure 'Found set(['10']) new fd(s) after the test' ignored: PROTON-1800: sut is leaking one fd on Ubuntu Xenial docker image"
29: test_send_message_ssl_no_object_leaks (test_PROTON_2111_container_ssl_ssldomain_object_leak.Proton2111Test)
29: Starts a broker with ssl acceptor, in a loop connects to it and sends message. ... ok
29: test_blocking_connection_object_leak (test_PROTON_2116_blocking_connection_object_leak.Proton2116Test)
29: Kills and restarts broker repeatedly, while client is reconnecting. ... ok
29: test_connection_close_all (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... total 0
29: lr-x------. 1 root root 64 Oct  1 08:07 0 -> pipe:[156586561]
29: l-wx------. 1 root root 64 Oct  1 08:07 1 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 10 -> /dev/urandom
29: lr-x------. 1 root root 64 Oct  1 08:07 12 -> /dev/urandom
29: l-wx------. 1 root root 64 Oct  1 08:07 2 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 3 -> pipe:[156674097]
29: l-wx------. 1 root root 64 Oct  1 08:07 4 -> /foo/proton/build/Testing/Temporary/LastTest_20201001-0804.log.tmp
29: l-wx------. 1 root root 64 Oct  1 08:07 5 -> pipe:[156674097]
29: lrwx------. 1 root root 64 Oct  1 08:07 6 -> socket:[156671465]
29: lrwx------. 1 root root 64 Oct  1 08:07 7 -> socket:[156677688]
29: expected failure
29: test_connection_close_all__do_not_check_test_broker (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... total 0
29: lr-x------. 1 root root 64 Oct  1 08:07 0 -> pipe:[156586561]
29: l-wx------. 1 root root 64 Oct  1 08:07 1 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 10 -> /dev/urandom
29: lr-x------. 1 root root 64 Oct  1 08:07 12 -> /dev/urandom
29: l-wx------. 1 root root 64 Oct  1 08:07 2 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 3 -> pipe:[156674097]
29: l-wx------. 1 root root 64 Oct  1 08:07 4 -> /foo/proton/build/Testing/Temporary/LastTest_20201001-0804.log.tmp
29: l-wx------. 1 root root 64 Oct  1 08:07 5 -> pipe:[156674097]
29: lrwx------. 1 root root 64 Oct  1 08:07 6 -> socket:[156671465]
29: lrwx------. 1 root root 64 Oct  1 08:07 7 -> socket:[156677688]
29: lrwx------. 1 root root 64 Oct  1 08:08 8 -> socket:[156677691]
29: FAIL
29: test_connection_receiver_close_all (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... total 0
29: lr-x------. 1 root root 64 Oct  1 08:07 0 -> pipe:[156586561]
29: l-wx------. 1 root root 64 Oct  1 08:07 1 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 10 -> /dev/urandom
29: lrwx------. 1 root root 64 Oct  1 08:08 11 -> socket:[156675380]
29: lr-x------. 1 root root 64 Oct  1 08:07 12 -> /dev/urandom
29: lrwx------. 1 root root 64 Oct  1 08:08 13 -> socket:[156675381]
29: l-wx------. 1 root root 64 Oct  1 08:07 2 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 3 -> pipe:[156674097]
29: l-wx------. 1 root root 64 Oct  1 08:07 4 -> /foo/proton/build/Testing/Temporary/LastTest_20201001-0804.log.tmp
29: l-wx------. 1 root root 64 Oct  1 08:07 5 -> pipe:[156674097]
29: lrwx------. 1 root root 64 Oct  1 08:07 6 -> socket:[156671465]
29: lrwx------. 1 root root 64 Oct  1 08:07 7 -> socket:[156677688]
29: lrwx------. 1 root root 64 Oct  1 08:08 8 -> socket:[156677691]
29: lrwx------. 1 root root 64 Oct  1 08:08 9 -> socket:[156673521]
29: expected failure
29: test_connection_sender_close_all (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... total 0
29: lr-x------. 1 root root 64 Oct  1 08:07 0 -> pipe:[156586561]
29: l-wx------. 1 root root 64 Oct  1 08:07 1 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 10 -> /dev/urandom
29: lrwx------. 1 root root 64 Oct  1 08:08 11 -> socket:[156675380]
29: lr-x------. 1 root root 64 Oct  1 08:07 12 -> /dev/urandom
29: lrwx------. 1 root root 64 Oct  1 08:08 13 -> socket:[156675381]
29: lrwx------. 1 root root 64 Oct  1 08:08 14 -> socket:[156671721]
29: lrwx------. 1 root root 64 Oct  1 08:08 15 -> socket:[156674402]
29: lrwx------. 1 root root 64 Oct  1 08:08 16 -> socket:[156671724]
29: l-wx------. 1 root root 64 Oct  1 08:07 2 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 3 -> pipe:[156674097]
29: l-wx------. 1 root root 64 Oct  1 08:07 4 -> /foo/proton/build/Testing/Temporary/LastTest_20201001-0804.log.tmp
29: l-wx------. 1 root root 64 Oct  1 08:07 5 -> pipe:[156674097]
29: lrwx------. 1 root root 64 Oct  1 08:07 6 -> socket:[156671465]
29: lrwx------. 1 root root 64 Oct  1 08:07 7 -> socket:[156677688]
29: lrwx------. 1 root root 64 Oct  1 08:08 8 -> socket:[156677691]
29: lrwx------. 1 root root 64 Oct  1 08:08 9 -> socket:[156673521]
29: expected failure
29: test_just_start_stop_test_broker (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests) ... total 0
29: lr-x------. 1 root root 64 Oct  1 08:07 0 -> pipe:[156586561]
29: l-wx------. 1 root root 64 Oct  1 08:07 1 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 10 -> /dev/urandom
29: lrwx------. 1 root root 64 Oct  1 08:08 11 -> socket:[156675380]
29: lr-x------. 1 root root 64 Oct  1 08:07 12 -> /dev/urandom
29: lrwx------. 1 root root 64 Oct  1 08:08 13 -> socket:[156675381]
29: lrwx------. 1 root root 64 Oct  1 08:08 14 -> socket:[156671721]
29: lrwx------. 1 root root 64 Oct  1 08:08 15 -> socket:[156674402]
29: lrwx------. 1 root root 64 Oct  1 08:08 16 -> socket:[156671724]
29: lrwx------. 1 root root 64 Oct  1 08:08 17 -> socket:[156674407]
29: l-wx------. 1 root root 64 Oct  1 08:07 2 -> pipe:[156674091]
29: lr-x------. 1 root root 64 Oct  1 08:07 3 -> pipe:[156674097]
29: l-wx------. 1 root root 64 Oct  1 08:07 4 -> /foo/proton/build/Testing/Temporary/LastTest_20201001-0804.log.tmp
29: l-wx------. 1 root root 64 Oct  1 08:07 5 -> pipe:[156674097]
29: lrwx------. 1 root root 64 Oct  1 08:07 6 -> socket:[156671465]
29: lrwx------. 1 root root 64 Oct  1 08:07 7 -> socket:[156677688]
29: lrwx------. 1 root root 64 Oct  1 08:08 8 -> socket:[156677691]
29: lrwx------. 1 root root 64 Oct  1 08:08 9 -> socket:[156673521]
29: expected failure
29: 
29: ======================================================================
29: FAIL: test_connection_close_all__do_not_check_test_broker (test_PROTON_2121_blocking_connection_fd_leak.BlockingConnectionFDLeakTests)
29: ----------------------------------------------------------------------
29: Traceback (most recent call last):
29:   File "/foo/proton/python/tests/integration/test_PROTON_2121_blocking_connection_fd_leak.py", line 141, in test_connection_close_all__do_not_check_test_broker
29:     gc.collect()
29:   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
29:     self.gen.next()
29:   File "/foo/proton/python/tests/integration/test_PROTON_2121_blocking_connection_fd_leak.py", line 59, in no_fd_leaks
29:     test.fail("Found {0} new fd(s) after the test".format(delta))
29: AssertionError: Found set(['11']) new fd(s) after the test
29: 
29: ----------------------------------------------------------------------
29: Ran 9 tests in 32.130s
29: 
29: FAILED (failures=1, skipped=1, expected failures=4)
29/46 Test #29: python-integration-test ..........***Failed   35.32 sec
test 30

Attachments

Activity

People

Assignee:: Jiri Daněk

Reporter:: Jiri Daněk

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 04/Oct/20 18:56

Updated:: 05/Nov/20 16:16