Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2114

Tez UI: task/task attempt status is not available when its running

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.6.1
    • Component/s: UI
    • Labels:
      None
    • Target Version/s:

      Description

      • The task/task attempt status is not available when the task/attempt is running.
      • the task/attempt status is not displayed when the application has been killed
      1. TEZ-2114.1.patch
        24 kB
        Prakash Ramachandran
      2. TEZ-2114.2.patch
        28 kB
        Prakash Ramachandran

        Activity

        Hide
        pramachandran Prakash Ramachandran added a comment -

        backend

        • log the task status as scheduled and task attempt as running to timeline when they start

        front end

        • display task/attempt status when its in running state.
        • when the dag has been killed use the yarn app state if available to display appropriate status.
        • removed the warning sign in from of successful dags when they had task attempt failures as this was inconsistent and likely to be false positive.
        Show
        pramachandran Prakash Ramachandran added a comment - backend log the task status as scheduled and task attempt as running to timeline when they start front end display task/attempt status when its in running state. when the dag has been killed use the yarn app state if available to display appropriate status. removed the warning sign in from of successful dags when they had task attempt failures as this was inconsistent and likely to be false positive.
        Hide
        pramachandran Prakash Ramachandran added a comment -

        Sreenath Somarajapuram can you review?

        Show
        pramachandran Prakash Ramachandran added a comment - Sreenath Somarajapuram can you review?
        Hide
        pramachandran Prakash Ramachandran added a comment -

        patch 2 fixes

        1. change the dropdown for task status filter to use scheduled.
        2. catch appdetail fetch, to handle case where the application data is not published to ATS (yarn.resourcemanager.system-metrics-publisher.enabled is false). it was causing an exception otherwise.
        3. dag index status icon was not showing
        Show
        pramachandran Prakash Ramachandran added a comment - patch 2 fixes change the dropdown for task status filter to use scheduled. catch appdetail fetch, to handle case where the application data is not published to ATS (yarn.resourcemanager.system-metrics-publisher.enabled is false). it was causing an exception otherwise. dag index status icon was not showing
        Hide
        Sreenath Sreenath Somarajapuram added a comment -

        +1 LGTM

        Show
        Sreenath Sreenath Somarajapuram added a comment - +1 LGTM
        Hide
        hitesh Hitesh Shah added a comment -

        +1 pending pre-commit.

        Show
        hitesh Hitesh Shah added a comment - +1 pending pre-commit.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12699307/TEZ-2114.2.patch
        against master revision 1653d18.

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in :
        org.apache.tez.test.TestTezJobs

        Test results: https://builds.apache.org/job/PreCommit-TEZ-Build/199//testReport/
        Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/199//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12699307/TEZ-2114.2.patch against master revision 1653d18. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in : org.apache.tez.test.TestTezJobs Test results: https://builds.apache.org/job/PreCommit-TEZ-Build/199//testReport/ Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/199//console This message is automatically generated.
        Hide
        hitesh Hitesh Shah added a comment -

        Thanks Prakash Ramachandran. Committed.

        Show
        hitesh Hitesh Shah added a comment - Thanks Prakash Ramachandran . Committed.
        Hide
        hitesh Hitesh Shah added a comment -

        Closing issue as 0.5.4, 0.6.1 and 0.7.0 have been released.

        Show
        hitesh Hitesh Shah added a comment - Closing issue as 0.5.4, 0.6.1 and 0.7.0 have been released.

          People

          • Assignee:
            pramachandran Prakash Ramachandran
            Reporter:
            pramachandran Prakash Ramachandran
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development