Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1476

DAGClient waitForCompletion output is confusing

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.5.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      When a DAG is submitted - "2014-08-21 16:38:06,153 INFO [main] rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:log(428)) - Waiting for DAG to start running" is logged.

      After this, nothing seems to get logged till the first task completes.

      It would be useful to log when the state changes to RUNNING - as well as at least one line stating the number of tasks, etc (0% progress line). Also, progress could be logged every few seconds irrespective of whether it has changed or not to give the impression that the job has not just gotten stuck.

        Attachments

        1. TEZ-1476-v1.patch
          5 kB
          Jonathan Turner Eagles
        2. TEZ-1476-v2.patch
          6 kB
          Jonathan Turner Eagles

          Activity

            People

            • Assignee:
              jeagles Jonathan Turner Eagles
              Reporter:
              sseth Siddharth Seth
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: