Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4097

Hive interaction with speculative execution is broken

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.19.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.

        Attachments

        1. hadoop-4097.1.patch
          6 kB
          Joydeep Sen Sarma

          Activity

            People

            • Assignee:
              jsensarma Joydeep Sen Sarma
              Reporter:
              jsensarma Joydeep Sen Sarma
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: