[KYLIN-4163] CreateFlatHiveTableStep has not yarn app url when hive job running

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: v3.0.0-alpha
• Fix Version/s: v3.0.0
• Component/s: Job Engine, Web
• Assignee: Unassigned
• Reporter: chuxiao
• Created: 10/Sep/19 08:32
• Updated: 21/Jan/20 07:48
• Resolved: 28/Oct/19 11:06

Description

CreateFlatHiveTableStep has yarn app url on the monitor web page only when job finished, but SparkExecutable has yarn app url when job running.
this is because of SparkExecutable`s logger has logger listener:

final PatternedLogger patternedLogger = new PatternedLogger(logger, new PatternedLogger.ILogListener() {
 @Override
 public void onLogEvent(String infoKey, Map<String, String> info) {
 // only care three properties here
 if (ExecutableConstants.SPARK_JOB_ID.equals(infoKey)
 || ExecutableConstants.YARN_APP_ID.equals(infoKey)
 || ExecutableConstants.YARN_APP_URL.equals(infoKey)) {
 getManager().addJobInfo(getId(), info);
 }
 }
 });

sometimes creating flat hive table hangs, so user wants to have yarn app url when hive job running  like attachment.

Issue Links

• links to: GitHub Pull Request #856