Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: tez
    • Labels:
      None

      Description

      Currently, Pig prints DAGStatus for Tez jobs every second. This generates a lot of info message in stderr. In particular, for long running jobs, every second status report seems unnecessary.

      1) Every 10 seconds seems reasonable for most jobs.
      2) But if the default isn't good, users should be able to configure via a property.

      1. PIG-4006-1.patch
        3 kB
        Cheolsoo Park

        Activity

        Cheolsoo Park created issue -
        Cheolsoo Park made changes -
        Field Original Value New Value
        Summary Make the interval of DAGStatus report configuration Make the interval of DAGStatus report configurable
        Cheolsoo Park made changes -
        Attachment PIG-4006-1.patch [ 12649630 ]
        Cheolsoo Park made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Cheolsoo Park made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Daniel Dai made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Cheolsoo Park
            Reporter:
            Cheolsoo Park
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development