Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2196

Consider reusing UnorderedPartitionedKVWriter with single output in UnorderedKVOutput

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.7.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Can possibly get rid of FileBasedKVWriter and reuse UnorderedPartitionedKVWriter with single partition in UnorderedKVOutput. This can also benefit from pipelined shuffle changes done in UnorderedPartitionedKVWriter.

        Attachments

        1. TEZ-2196.1.patch
          32 kB
          Rajesh Balamohan
        2. TEZ-2196.2.patch
          41 kB
          Rajesh Balamohan
        3. TEZ-2196.3.patch
          46 kB
          Rajesh Balamohan
        4. TEZ-2196.4.patch
          48 kB
          Rajesh Balamohan

          Activity

            People

            • Assignee:
              rajesh.balamohan Rajesh Balamohan
              Reporter:
              rajesh.balamohan Rajesh Balamohan
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: