[FLINK-11990] Streaming bucketing end-to-end test fail with hadoop 2.8

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Not A Problem
• Component/s: Connectors / Hadoop Compatibility
• Assignee: Unassigned
• Reporter: Yu Li
• Created: 21/Mar/19 11:16
• Updated: 21/Mar/19 20:38
• Resolved: 21/Mar/19 15:53

Description

As titled, running the test_streaming_bucketing.sh case with hadoop 2.8 bundles always fail, while running with 2.6 bundles could pass.

Command to run the case:
FLINK_DIR=<flink dir> flink-end-to-end-tests/run-single-test.sh test-scripts/test_streaming_bucketing.sh skip_check_exceptions

The output with hadoop 2.8 bundle or dist:

Starting taskexecutor daemon on host z05f06378.sqa.zth.
Waiting for job (905ae10bae4b99031e724b9c29f0ca7b) to reach terminal state FINISHED ...
Truncating buckets
Truncating  to

The output of the success run with hadoop 2.6 bundle or dist:

Truncating /home/jueding.ly/flink_rc_check/flink-1.8.0-src/flink-end-to-end-tests/test-scripts/temp-test-directory-06210353709/out/result3/part-3-0 to 51250
1+0 records in
1+0 records out
51250 bytes (51 kB) copied, 0.000377998 s, 136 MB/s
Truncating /home/jueding.ly/flink_rc_check/flink-1.8.0-src/flink-end-to-end-tests/test-scripts/temp-test-directory-06210353709/out/result7/part-3-0 to 51250
1+0 records in
1+0 records out
51250 bytes (51 kB) copied, 0.00033118 s, 155 MB/s
pass Bucketing Sink