[FLINK-19536] Fix inconsistent priority notification

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.12.0
• Component/s: Runtime / Network
• Labels: pull-request-available
• Assignee: Arvid Heise
• Reporter: Arvid Heise
• Created: 08/Oct/20 12:32
• Updated: 22/Jun/21 14:06
• Resolved: 23/Nov/20 13:14

Description

Some blink tests fail with unaligned checkpoint enabled

[ERROR]   JoinITCase.testFullJoinWithPkNonEqui[StateBackend=ROCKSDB] » JobExecution Job ...
[ERROR]   JoinITCase.testJoinRetractionWithSameRecord[StateBackend=ROCKSDB] » JobExecution
[ERROR]   JoinITCase.testLeftJoinWithPk[StateBackend=HEAP] » JobExecution Job execution ...
[ERROR]   JoinITCase.testLeftOuterJoinWithoutPrimaryKey[StateBackend=HEAP] » JobExecution
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.AggregateITCase.testCountDistinctWithBinaryRowSource[LocalGlobal=OFF, MiniBatch=OFF, StateBackend=HEAP](org.apache.flink.table.planner.runtime.stream.sql.AggregateITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.AggregateITCase.testCountDistinctWithBinaryRowSource[LocalGlobal=OFF, MiniBatch=ON, StateBackend=HEAP](org.apache.flink.table.planner.runtime.stream.sql.AggregateITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.AggregateITCase.testCountDistinctWithBinaryRowSource[LocalGlobal=ON, MiniBatch=ON, StateBackend=HEAP](org.apache.flink.table.planner.runtime.stream.sql.AggregateITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.AggregateITCase.testCountDistinctWithBinaryRowSource[LocalGlobal=ON, MiniBatch=ON, StateBackend=ROCKSDB](org.apache.flink.table.planner.runtime.stream.sql.AggregateITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.SetOperatorsITCase.testMinusAll[StateBackend=HEAP](org.apache.flink.table.planner.runtime.stream.sql.SetOperatorsITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.SetOperatorsITCase.testMinusAll[StateBackend=ROCKSDB](org.apache.flink.table.planner.runtime.stream.sql.SetOperatorsITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase.testCountDistinctWithBinaryRowSource[PartialAgg=ON, LocalGlobal=OFF, StateBackend=HEAP](org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase.testCountDistinctWithBinaryRowSource[PartialAgg=ON, LocalGlobal=OFF, StateBackend=ROCKSDB](org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase.testCountDistinctWithBinaryRowSource[PartialAgg=ON, LocalGlobal=ON, StateBackend=HEAP](org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase.testCountDistinctWithBinaryRowSource[PartialAgg=ON, LocalGlobal=ON, StateBackend=ROCKSDB](org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase)
[ERROR] org.apache.flink.table.planner.runtime.stream.table.JoinITCase.testLeftOuterJoinWithTwoSideJoinKeyContainPrimaryKey[StateBackend=ROCKSDB](org.apache.flink.table.planner.runtime.stream.table.JoinITCase)

The root cause seems to be inconsistent priority notifications.

Issue Links

• is fixed by: FLINK-20145 Streaming job fails with IllegalStateException: Should only poll priority events
• links to: GitHub Pull Request #13563