[TEZ-3861] PipelineSorter setting negative progess

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.1
• Fix Version/s: 0.9.1
• Target Version/s: 0.9.1
• Hadoop Flags: Reviewed
• Assignee: Rajesh Balamohan
• Reporter: Prasanth Jayachandran
• Created: 30/Oct/17 08:38
• Updated: 05/Jan/18 00:18
• Resolved: 01/Nov/17 22:20

Description

PipelineSorter is generating too big log mostly coming from setting progress to negative value in some cases.

2017-10-30T01:22:16,466 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
2017-10-30T01:22:16,469 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
2017-10-30T01:22:16,469 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
2017-10-30T01:22:16,470 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
2017-10-30T01:22:16,470 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0

this is emitted from
https://github.com/apache/tez/blob/87d7c145ffc71707d1d393fddf94efa2a77d8822/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/sort/impl/PipelinedSorter.java#L1126