[TEZ-1104] TezProcessor.setupMRLegacyConfigs() creates task IDs which are not valid Hadoop TaskAttemptID strings

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 0.4.0
• Labels: mapreduce

Environment

Hadoop 2.2.0

• Assignee: Unassigned
• Reporter: Craig Condit
• Created: 06/May/14 18:56
• Updated: 07/May/14 16:57
• Resolved: 06/May/14 19:20

Description

When executing MR jobs via Tez, the values assigned to mapred.task.id and mapreduce.task.id cause exceptions to be thrown if these values are passed to TaskAttempID.forName():

	java.lang.IllegalArgumentException: TaskAttemptId string : task1396892688715_80817_m_000076_3 is not properly formed
		at org.apache.hadoop.mapreduce.TaskAttemptID.forName(TaskAttemptID.java:201)
		at org.apache.hadoop.hive.ql.io.parquet.write.ParquetRecordWriterWrapper.<init>(ParquetRecordWriterWrapper.java:49)

Perhaps TezProcessor should start with:

StringBuilder taskAttemptIdBuilder = new StringBuilder("attempt_");

instead of

StringBuilder taskAttemptIdBuilder = new StringBuilder("task");

?