Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
We may want to create hive tables on top of audit data generated by ranger (not only HDFS audit but other services as well) to be able to analyze the same.
Based on this case, some audit records may become corrupt. Improving the hive built-in json serde to provide an option (in tblproperties and via session configurations for example) to allow ignoring malformed records (or to provide empty rows) would assist users achieve this goal without using third-party/custom serdes,
for example:
#see ignore.malformed.json