[IMPALA-6645] Consider enabling disk spill encryption by default

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Not Applicable
• Fix Version/s: Impala 2.13.0, Impala 3.1.0
• Component/s: Backend
• Labels: resource-management
• Target Version: Product Backlog
• Epic Color: ghx-label-6
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 12/Mar/18 22:23
• Updated: 16/May/18 23:52
• Resolved: 16/May/18 23:52

Description

We currently have integrity checks disabled by default because of the additional CPU cost.

Now that IMPALA-6219 is in, the integrity checks are cheaper so it may be worth just paying the cost. We could also consider doing a lighter-weight CRC checksum, but AES-GCM may be fast enough at 2.3GB/s to do by default.

We should do an experiment to see if there's a major impact on spill-to-disk perf.

Issue Links

• depends upon: IMPALA-6219 Use AES-GCM for spill-to-disk encryption when CLMUL instruction is present and performant
• is related to: IMPALA-6637 SIGSEGV at impala::BufferedTupleStream::FixUpStringsForRead()