[TEZ-1878] Task-specific log level override not working in certain conditions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.4
• Target Version/s: 0.5.4
• Assignee: Siddharth Seth
• Reporter: Hitesh Shah
• Created: 19/Dec/14 22:52
• Updated: 30/Jun/15 04:53
• Resolved: 22/Dec/14 20:31

Description

When trying to use the feature from TEZ-1775:

tez.task.log.level is set to "DEBUG;org.apache.hadoop.ipc=INFO;org.apache.hadoop.security=INFO;"

Running a job with overrides:

${HADOOP_COMMON_HOME}/bin/hadoop jar tez/tez-tests-0.6.0-SNAPSHOT.jar testorderedwordcount -DUSE_MR_CONFIGS=false -DINTER_JOB_SLEEP_INTERVAL=10 -Dtez.task-specific.launch.cmd-opts.list="finalreduce[]" -Dtez.task-specific.log.level="INFO" /tmp/in1 /tmp/out1

In the above case, I see TEZ_CONTAINER_LOG_PARAMS setup incorrectly for the container in which the final reducer tasks were run.