[IMPALA-7934] Switch to using Java 8's Base64 impl for incremental stats encoding

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 3.2.0
• Component/s: Catalog
• Labels: ramp-up
• Epic Color: ghx-label-4
• Assignee: Fredy Wijaya
• Reporter: Bharath Vissapragada
• Created: 06/Dec/18 06:01
• Updated: 01/Feb/19 19:15
• Resolved: 01/Feb/19 07:19

Description

Incremental stats are compressed and Base64 encoded before they are chunked and written to the HMS' partition parameters map. When they are read back, we need to Base64 decode and decompress. 

For certain incremental stats heavy tables, we noticed that a significant amount of time is spent in these base64 classes (see the attached image for the stack. Unfortunately, I don't have the text version of it).

Java 8 comes with its own Base64 implementation and that has shown much better perf results [1] compared to apache codec's impl. So consider switching to Java 8's base64 impl.

 [1] http://java-performance.info/base64-encoding-and-decoding-performance/