[KYLIN-5246] Long running job's log staying in mem, may cause job server oom

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: v4.0.1
• Fix Version/s: v4.0.3
• Component/s: Job Engine
• Assignee: Liu Zhao
• Reporter: Liu Zhao
• Created: 31/Aug/22 07:09
• Updated: 22/Dec/22 02:09
• Resolved: 16/Dec/22 11:13

Description

CliCommandExecutor
--------
BufferedReader reader = new BufferedReader(
		new InputStreamReader(proc.getInputStream(), StandardCharsets.UTF_8));
String line;
StringBuilder result = new StringBuilder();
while ((line = reader.readLine()) != null && !Thread.currentThread().isInterrupted()) {
	result.append(line).append('\n');
	if (logAppender != null) {
		logAppender.log(line);
	}
}

job运行时间久，result 会非常大，可能会引起内存问题