[TEZ-1094] Support pipelined data transfer for Unordered Output - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Target Version/s:

0.7.0
Hadoop Flags:

Reviewed

Description

For unsorted output (and possibly for sorted output), it should be possible to send data in small batches instead of waiting for everything to be generated before transmitting. For now, planning on getting started with UnsortedOutput / Input pairs.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

TEZ-1094.3.patch
12/Mar/15 06:34
79 kB
Rajesh Balamohan
TEZ-1094.2.patch
11/Mar/15 10:08
79 kB
Rajesh Balamohan
TEZ-1094.1.patch
08/Mar/15 23:52
57 kB
Rajesh Balamohan

Issue Links

relates to

TEZ-1991 Introduce additional DataMovementEvent types

Open

TEZ-1992 Move event tracking into Edges instead of Tasks

Open

TEZ-2001 Support pipelined data transfer for ordered output

Closed

Activity

People

Assignee:: Rajesh Balamohan

Reporter:: Siddharth Seth

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 01/May/14 21:16

Updated:: 12/Mar/15 20:34

Resolved:: 12/Mar/15 09:12