Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3334 Tez Custom Shuffle Handler
  3. TEZ-3408

Allow Task Output Files to reside in DAG specific directories for Custom Shuffle Handler

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.9.0
    • None
    • None

    Description

      When configured to use Custom Tez Shuffle Handler, the task output files can be in DAG specific output directories,for example: {appDir}/dag_123/output/${uniqueId}/file.out
      This is one step towards multiple files feature.

      Attachments

        1. TEZ-3408.004.patch
          41 kB
          Kuhu Shukla
        2. TEZ-3408.003.patch
          43 kB
          Kuhu Shukla
        3. TEZ-3408.002.patch
          41 kB
          Kuhu Shukla
        4. TEZ-3408.001.patch
          44 kB
          Kuhu Shukla

        Activity

          People

            kshukla Kuhu Shukla
            kshukla Kuhu Shukla
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: