Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3317

Speculative execution starts too early due to 0 progress

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.2, 0.9.0, 0.8.5
    • None
    • None
    • Reviewed

    Description

      Don't know at this point if this is a tez or a PigProcessor issue. There is some setProgress chain that is keeping task progress from being correctly reported. Task status is always zero, so as soon as the first task finishes, tasks up to the speculation limit are always launched.

      Attachments

        1. TEZ-3317.001.patch
          11 kB
          Kuhu Shukla
        2. TEZ-3317.002.patch
          17 kB
          Kuhu Shukla
        3. TEZ-3317.003.patch
          25 kB
          Kuhu Shukla
        4. TEZ-3317.004.patch
          29 kB
          Kuhu Shukla
        5. TEZ-3317.005.patch
          33 kB
          Kuhu Shukla
        6. TEZ-3317.006.patch
          33 kB
          Kuhu Shukla
        7. TEZ-3317.007.patch
          36 kB
          Kuhu Shukla
        8. TEZ-3317.008.patch
          40 kB
          Kuhu Shukla
        9. TEZ-3317.009.patch
          40 kB
          Kuhu Shukla
        10. TEZ-3317.010.patch
          40 kB
          Kuhu Shukla
        11. TEZ-3317.branch-0.7.001.patch
          40 kB
          Kuhu Shukla
        12. TEZ-3317.branch-0.8.001.patch
          40 kB
          Kuhu Shukla

        Issue Links

          Activity

            People

              kshukla Kuhu Shukla
              jeagles Jonathan Turner Eagles
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: