[SPARK-6712] Allow lower the log level in YARN client while keeping AM tracking URL printed

• Type: Improvement
• Status: Closed
• Priority: Trivial
• Resolution: Won't Fix
• Affects Version/s: 1.3.0
• Component/s: YARN
• Labels: yarn
• Assignee: Unassigned
• Reporter: Cheolsoo Park
• Created: 05/Apr/15 05:56
• Updated: 06/Apr/15 04:31
• Resolved: 06/Apr/15 04:31

Description

In YARN mode, log messages are quite verbose in interactive shells (spark-shell, spark-sql, pyspark), and they sometimes mingle with shell prompts. In fact, it's very easy to tone it down via log4j.properties, but the problem is that the AM tracking URL is not printed if I do that.

It would be nice if I could keep the AM tracking URL while disabling the other INFO messages that don't matter to most end users.

Issue Links

• links to: [Github] Pull Request #5362 (piaozhexiu)