[DRILL-3672] Data Provenance and DFS metadata

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.1.0
• Fix Version/s: Future
• Component/s: Metadata, Storage - Text & CSV
• Labels: features file metadata provenance

Environment

1

• Flags: Important
• Assignee: Unassigned
• Reporter: Ajith Dharwar
• Created: 19/Aug/15 12:37
• Updated: 01/Oct/15 16:38

Description

My present query on Apache Drill is as follows -

select
CAST(columns[0] AS Integer) as ID,
to_timestamp(SUBSTR(columns[10],1,14),'YYYYMMddHHmmss') as RecordDt
from dfs.`/data/100Krows/`
What I would like to do is get the modificationTime metadata for each of the .csv files in my folder as a column something like this -

select
CAST(columns[0] AS Integer) as ID,
to_timestamp(SUBSTR(columns[10],1,14),'YYYYMMddHHmmss') as RecordDt,
modificationTime as versionStartTime
from dfs.`/data/100Krows/`
The modificationTime along with filename metadata can be found when I run the following qry

SHOW FILES in dfs.data
Is there a way to achieve this in its current version 1.1 or 1.0?