[HIVE-13027] Configuration changes to improve logging performance

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.0
• Component/s: Logging
• Assignee: Prasanth Jayachandran
• Reporter: Prasanth Jayachandran
• Created: 09/Feb/16 01:51
• Updated: 01/Sep/16 05:47
• Resolved: 06/May/16 08:10

Description

For LLAP and HS2, some configuration changes can be made to improve logging performance
1) LOG4j2's async logger claims to have 6-68 times better performance than synchronous logger. https://logging.apache.org/log4j/2.x/manual/async.html
2) Replace File appenders with RandomAccessFileAppender that claims to be 20-200% more performant.
https://logging.apache.org/log4j/2.x/manual/appenders.html#RandomAccessFileAppender

Also make async logging configurable.

Issue Links

• depends upon: HIVE-13110 LLAP: Package log4j2 jars into Slider pkg
• links to: RB