[TEZ-3453] Correct the downloaded ATS dag data location for analyzer

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Hadoop Flags: Reviewed
• Assignee: Unassigned
• Reporter: Dharmesh Kakadia
• Created: 29/Sep/16 21:30
• Updated: 22/Aug/17 00:03
• Resolved: 12/Oct/16 00:33

Description

hadoop jar /usr/hdp/current/tez-client/tez-job-analyzer-*.jar CriticalPath --dagId=dag_1475171170456_0002_1 --outputDir=tmp/
fails with

INFO history.ATSImportTool: Using baseURL=http://headnodehost:8188/ws/v1/timeline, dagId=dag_1475171170456_0002_1, batchSize=100, downloadDir=tmp
java.lang.IllegalArgumentException: Zipfile tmp/dag_1475171170456_0002_1/dag_1475171170456_0002_1.zip does not exist
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
at org.apache.tez.history.parser.ATSFileParser.(ATSFileParser.java:65)
at org.apache.tez.analyzer.plugins.TezAnalyzerBase.run(TezAnalyzerBase.java:169)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.tez.analyzer.plugins.CriticalPathAnalyzer.main(CriticalPathAnalyzer.java:653)

The code is incorrectly expecting it to be in subfolder(dag_1475171170456_0002_1/dag_1475171170456_0002_1.zip). Moving the downloaded data location to the subfolder fixes the issue. This PR corrects the expected path.

Issue Links

• links to: GitHub Pull Request #16