[TEZ-135] Let there be hive

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.2.0
• Labels: TEZ-0.2.0 TEZ-1
• Assignee: Gunther Hagleitner
• Reporter: Gunther Hagleitner
• Created: 17/May/13 07:57
• Updated: 16/Oct/14 04:31
• Resolved: 10/Jan/14 02:44

Description

Changes tracking Hive to run on Tez

Issue Links

• depends upon: TEZ-118 Create a MiniMRRTezCluster for allowing of unit tests
• is blocked by: TEZ-361 Tez sometimes returns 0 tasks (total task count)
• is blocked by: TEZ-529 Hive communicates state from RecordReader to Processor via JobConf
• is blocked by: TEZ-357 TaskLocalResources should be task specific
• is blocked by: TEZ-358 Tez fails with multiple root tasks
• is blocked by: TEZ-576 Allow inputs in different vertices to have the same name
• is blocked by: TEZ-611 Should throw SessionNotRunning if session has not been started or has been stopped
• is blocked by: TEZ-682 TezGroupedSplits fails with empty (zero length) file
• is depended upon by: TEZ-354 Allow updating of payload during dag construction
• relates to: TEZ-146 Support for TaskReports
• relates to: TEZ-147 Handling JobPriorities
• relates to: TEZ-349 Add initial support for Tez Sessions
• relates to: HIVE-4660 Let there be Tez

Sub-Tasks

• Hive needs a way to figure out which M/R stage a task belongs to: Closed
• Support for TaskReports: Resolved
• Handling JobPriorities: Resolved
• Basic fixes for Hive: Closed
• Can I has API to submit/run DAG w/o going thru JobClient?: Closed
• Can I has API to attach configuration to Vertices and Edges?: Closed
• Add helper apis to generate splits for applications moving away from MR to Tez: Closed
• Add helper api to generate jvm options for map and reduce vertices from MR configs: Closed
• 0 number of tasks causes Arithmetic exception: Closed
• Setting output committer causes class not found exception: Resolved