Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3861

PipelineSorter setting negative progess

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.1
    • Fix Version/s: 0.9.1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      PipelineSorter is generating too big log mostly coming from setting progress to negative value in some cases.

      2017-10-30T01:22:16,466 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
      2017-10-30T01:22:16,469 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
      2017-10-30T01:22:16,469 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
      2017-10-30T01:22:16,470 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
      2017-10-30T01:22:16,470 DEBUG [TezTR-702853_1_1_2_0_0] util.Progress: Illegal progress value found, progress is less than 0. Progress will be changed to 0
      

      this is emitted from
      https://github.com/apache/tez/blob/87d7c145ffc71707d1d393fddf94efa2a77d8822/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/sort/impl/PipelinedSorter.java#L1126

        Attachments

        1. TezTR-545720_1_1_2_0_0.log
          218 kB
          Prasanth Jayachandran
        2. TEZ-3861.2.patch
          0.9 kB
          Rajesh Balamohan

          Activity

            People

            • Assignee:
              rajesh.balamohan Rajesh Balamohan
              Reporter:
              prasanth_j Prasanth Jayachandran
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: