Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-4320

DAGAppMaster progress not updated correctly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      We found TEZ progress stays at 0% (from ResourceManager WebUI or REST) for most of times.  While for some simple queries, it can be correctly updated.

      After some debugging, it seems due to the fix of TEZ-3982 :
       

      +      float dagProgress = progress / getTotalVertices();
      +      if (dagProgress >= 0.0f && progress <= 1.0f) {
      +        return dagProgress;
      +      } else {
      +        return 0.0f;
      

      So the dagProgress will be only updated if progress is less than 1.0, but it's not true for most cases.

      Attachments

        1. TEZ-4320.patch
          0.7 kB
          Xiaomin Zhang

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ximz Xiaomin Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: