[IMPALA-801] Add function or virtual column for file name

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Impala 1.2.3
• Fix Version/s: Impala 4.2.0
• Component/s: Catalog
• Labels: built-in-function impala-iceberg ramp-up
• Epic Link: Iceberg V2 format
• Target Version: Product Backlog
• Assignee: Zoltán Borók-Nagy
• Reporter: Udai Kiran Potluri
• Created: 13/Feb/14 05:25
• Updated: 19/Sep/22 11:23
• Resolved: 09/Jun/22 12:30

Description

Hive can list the data files in a table. For eg the following query lists all the data files for the table or partition:

select INPUT__FILE__NAME, count(*) from <table_name> where dt='20140210' group by INPUT__FILE__NAME;

This has two advantages over the existing "show files" functionality:

• The output can be used in arbitrary SQL statements.
• You can see which record came from which file.

Issue Links

• is duplicated by: IMPALA-11168 Add pseudo-columns for Impala