[HIVE-4825] Separate MapredWork into MapWork and ReduceWork - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Minor
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.12.0
Component/s: None
Labels:
None

Description

Right now all the information needed to run an MR job is captured in MapredWork. This class has aliases, tagging info, table descriptors etc.

For Tez and MRR it will be useful to break this into map and reduce specific pieces. The separation is natural and I think has value in itself, it makes the code easier to understand. However, it will also allow us to reuse these abstractions in Tez where you'll have a graph of these instead of just 1M and 0-1R.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-4825.1.patch
09/Jul/13 00:13
361 kB
Gunther Hagleitner
HIVE-4825.2.code.patch
15/Jul/13 06:01
200 kB
Gunther Hagleitner
HIVE-4825.2.testfiles.patch
15/Jul/13 06:01
1.71 MB
Gunther Hagleitner
HIVE-4825.3.testfiles.patch
16/Jul/13 08:25
1.71 MB
Gunther Hagleitner
HIVE-4825.4.patch
23/Jul/13 09:26
1.90 MB
Gunther Hagleitner
HIVE-4825.5.patch
27/Jul/13 02:35
1.90 MB
Gunther Hagleitner
HIVE-4825.6.patch
27/Jul/13 08:17
1.91 MB
Gunther Hagleitner

Issue Links

blocks

HIVE-4660 Let there be Tez

Resolved

relates to

HIVE-4955 serde_user_properties.q.out needs to be updated

Closed

Activity

People

Assignee:: Gunther Hagleitner

Reporter:: Gunther Hagleitner

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 09/Jul/13 00:05

Updated:: 15/Oct/13 23:30

Resolved:: 29/Jul/13 15:50