[ORC-582] column encrpytion did not work on partition table

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.6.0, 1.6.1, 1.6.2
• Component/s: Java
• Assignee: Unassigned
• Reporter: chong chow
• Created: 18/Dec/19 08:10
• Updated: 18/Dec/19 08:40

Description

i have integrate the column encryption feature to our spark cluster.

when i test in non-partition table ,it works well.

but i test in partition table, it seems column encryption not work.

i test in these steps:

• create a non-partition table A with tblproperties("orc.encrypt"="key:columnName")
• insert into table A select * form originTable, this step work well
• shut down the kms service 
• insert into table select * form originTable, then will throw a exception about kms service
• create a partition table B with tblproperties("orc.encrypt"="key:columnName")
• insert into table B select * form originTable, this step work well
• shut down the kms service
• insert into table select * form originTable, this step also work well
• i take a look at the file in hdfs,  the file of table A has key info , but the file of table B has no key info