[HIVE-17112] Reduce logging in HiveSparkClientFactory and RemoteHiveSparkClient

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Spark
• Target Version/s: 3.0.0
• Assignee: Sahil Takiar Assign to me
• Reporter: Sahil Takiar
• Created: 17/Jul/17 20:30
• Updated: 22/May/18 23:58
• Resolved: 21/Sep/17 04:24

Description

HiveSparkClientFactory has the following line that introduces excess logging:

LOG.info(String.format(
              "load spark property from %s (%s -> %s).",
              SPARK_DEFAULT_CONF_FILE, propertyName, LogUtils.maskIfPassword(propertyName,value)));

It basically dumps the entire configuration object to the logs, we can probably change this from INFO to DEBUG.

Same thing happens in RemoteHiveSparkClient#logConfigurations