[FLINK-24264] Streaming File Sink s3 end-to-end test fail with output mismatch

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.14.0, 1.13.5
• Component/s: Connectors / FileSystem, Tests
• Assignee: Unassigned
• Reporter: Dawid Wysakowicz
• Created: 13/Sep/21 06:16
• Updated: 02/Feb/22 13:57

Description

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23962&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=11428

Sep 13 04:56:55 Job (3a7555e3ea003b5f2be486786d66197d) reached terminal state CANCELED
Sep 13 04:56:56 FAIL File Streaming Sink: Output hash mismatch.  Got e700d1164e7deb36fbbd95c38ff62897, expected 6727342fdd3aae2129e61fc8f433fb6f.
Sep 13 04:56:56 head hexdump of actual:
Sep 13 04:56:56 0000000   E   r   r   o   r       e   x   e   c   u   t   i   n   g    
Sep 13 04:56:56 0000010   a   w   s       c   o   m   m   a   n   d   :       s   3    
Sep 13 04:56:56 0000020   c   p       -   -   q   u   i   e   t       s   3   :   /   /
Sep 13 04:56:56 0000030   f   l   i   n   k   -   i   n   t   e   g   r   a   t   i   o
Sep 13 04:56:56 0000040   n   -   t   e   s   t   s   /   t   e   m   p   /   t   e   s
Sep 13 04:56:56 0000050   t   _   f   i   l   e   _   s   i   n   k   -   6   8   4   6
Sep 13 04:56:56 0000060   c   8   2   1   -   3   b   5   8   -   4   c   6   6   -   b
Sep 13 04:56:56 0000070   0   e   f   -   3   2   0   3   2   a   7   3   4   4   1   3
Sep 13 04:56:56 0000080       /   h   o   s   t   d   i   r   /   /   t   e   m   p   -
Sep 13 04:56:56 0000090   t   e   s   t   -   d   i   r   e   c   t   o   r   y   -   4
Sep 13 04:56:56 00000a0   1   9   6   9   4   8   8   4   2   0   /   t   e   m   p   /
Sep 13 04:56:56 00000b0   t   e   s   t   _   f   i   l   e   _   s   i   n   k   -   6
Sep 13 04:56:56 00000c0   8   4   6   c   8   2   1   -   3   b   5   8   -   4   c   6
Sep 13 04:56:56 00000d0   6   -   b   0   e   f   -   3   2   0   3   2   a   7   3   4
Sep 13 04:56:56 00000e0   4   1   3       -   -   e   x   c   l   u   d   e       '   *
Sep 13 04:56:56 00000f0   '       -   -   i   n   c   l   u   d   e       '   *   /   p
Sep 13 04:56:56 0000100   a   r   t   -   [   !   /   ]   *   '       -   -   r   e   c
Sep 13 04:56:56 0000110   u   r   s   i   v   e  \n                                    
Sep 13 04:56:56 0000117
Sep 13 04:56:56 Stopping job timeout watchdog (with pid=408779)
rm: cannot remove '/home/vsts/work/1/s/flink-dist/target/flink-1.14-SNAPSHOT-bin/flink-1.14-SNAPSHOT/lib/flink-shaded-netty-tcnative-static-*.jar': No such file or directory

Issue Links

• is duplicated by: FLINK-24265 Streaming File Sink s3 end-to-end test fails due to Output hash mismatch