[IMPALA-6985] Impala View Does Not Populate Table Input/Output Format Class

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Catalog
• Epic Color: ghx-label-6
• Assignee: Unassigned
• Reporter: David Mollitor
• Created: 07/May/18 21:13
• Updated: 08/May/18 13:06

Description

When a view is created in Impala, the InputFormat and OutputFormat fields are set to NULL. This is breaking some aspects of Hive. See: HIVE-19424. Perhaps Impala can play nice here and set these fields the same as Hive.

-- hive
CREATE VIEW test_view_hive AS select * from sample_07;

-- impala
CREATE VIEW test_view_impala AS select * from sample_07;

-- Impala
DESCRIBE extended test_view_impala;

InputFormat - (blank)
OutputFormat - (blank)

DESCRIBE extended test_view_hive;

InputFormat - org.apache.hadoop.mapred.TextInputFormat
OutputFormat - org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat

You can see the difference in the Hive Metastore.

MariaDB [hive1]> SELECT TBLS.TBL_NAME FROM TBLS JOIN SDS ON TBLS.SD_ID=SDS.SD_ID WHERE SDS.INPUT_FORMAT IS NULL;

+------------------+
| TBL_NAME         |
+------------------+
| test_view_impala |
+------------------+

Issue Links

• relates to: HIVE-19424 NPE In MetaDataFormatters