Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2196

Consider reusing UnorderedPartitionedKVWriter with single output in UnorderedKVOutput

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None
    • None
    • Reviewed

    Description

      Can possibly get rid of FileBasedKVWriter and reuse UnorderedPartitionedKVWriter with single partition in UnorderedKVOutput. This can also benefit from pipelined shuffle changes done in UnorderedPartitionedKVWriter.

      Attachments

        1. TEZ-2196.1.patch
          32 kB
          Rajesh Balamohan
        2. TEZ-2196.2.patch
          41 kB
          Rajesh Balamohan
        3. TEZ-2196.3.patch
          46 kB
          Rajesh Balamohan
        4. TEZ-2196.4.patch
          48 kB
          Rajesh Balamohan

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rajesh.balamohan Rajesh Balamohan
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment