[HIVE-27575] MASK_HASH UDF generate a log per row

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0-alpha-2
• Fix Version/s: 4.0.0
• Component/s: UDF
• Labels: pull-request-available
• Assignee: Shohei Okumiya
• Reporter: Shohei Okumiya
• Created: 07/Aug/23 22:02
• Updated: 29/Mar/24 17:49
• Resolved: 09/Aug/23 14:19

Description

Hive 4 started generating too many logs since we merged the following patch.
https://issues.apache.org/jira/browse/HIVE-26724

Unable to find source-code formatter for language: txt. Available languages are: actionscript, ada, applescript, bash, c, c#, c++, cpp, css, erlang, go, groovy, haskell, html, java, javascript, js, json, lua, none, nyan, objc, perl, php, python, r, rainbow, ruby, scala, sh, sql, swift, visualbasic, xml, yaml

$ ./bin/logs hive-hiveserver2-859d7686f7-8tkj8 | grep MaskHashTransformer
hive-hiveserver2-859d7686f7-8tkj8: 2023-08-07T21:55:50,360  INFO [HiveServer2-Background-Pool: Thread-90] generic.MaskHashTransformer: Using SHA256 for masking
hive-hiveserver2-859d7686f7-8tkj8: 2023-08-07T21:55:50,361  INFO [HiveServer2-Background-Pool: Thread-90] generic.MaskHashTransformer: Using SHA256 for masking
hive-hiveserver2-859d7686f7-8tkj8: 2023-08-07T21:55:50,361  INFO [HiveServer2-Background-Pool: Thread-90] generic.MaskHashTransformer: Using SHA256 for masking
hive-hiveserver2-859d7686f7-8tkj8: 2023-08-07T21:55:50,361  INFO [HiveServer2-Background-Pool: Thread-90] generic.MaskHashTransformer: Using SHA256 for masking
hive-hiveserver2-859d7686f7-8tkj8: 2023-08-07T21:55:50,361  INFO [HiveServer2-Background-Pool: Thread-90] generic.MaskHashTransformer: Using SHA256 for masking

Issue Links

• is caused by: HIVE-26724 Mask UDF failing with NPE
• links to: GitHub Pull Request #4558