Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1476

DAGClient waitForCompletion output is confusing

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 0.5.0
    • None
    • None

    Description

      When a DAG is submitted - "2014-08-21 16:38:06,153 INFO [main] rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:log(428)) - Waiting for DAG to start running" is logged.

      After this, nothing seems to get logged till the first task completes.

      It would be useful to log when the state changes to RUNNING - as well as at least one line stating the number of tasks, etc (0% progress line). Also, progress could be logged every few seconds irrespective of whether it has changed or not to give the impression that the job has not just gotten stuck.

      Attachments

        1. TEZ-1476-v1.patch
          5 kB
          Jonathan Turner Eagles
        2. TEZ-1476-v2.patch
          6 kB
          Jonathan Turner Eagles

        Activity

          People

            jeagles Jonathan Turner Eagles
            sseth Siddharth Seth
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: