[HIVE-25660] File Format (ORC/AVRO/TextFile...) available in information schema for bulk query

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: File Formats, Metastore
• Assignee: Unassigned Assign to me
• Reporter: Simon AUBERT
• Created: 28/Oct/21 14:54
• Updated: 28/Oct/21 15:02

Description

Hello all,

As of today, when you want to know the file format of every table, you have, as far I know, two solutions :
-a loop in shell
-a loop in the tool you use for HQL queries, and then parse the answer, etc..

I think this is way too complicated for such a very basic need. So a table_file_format (or partition_file_format, I don't know) in the information_schema would be a very precious help for monitoring. It can be directly read by a reporting tool (Superset, Tableau, PowerBi, Qlik, whatever you want).

Best regards,

Simon