Schema can be used while reading the table into two ways:
a. schema is created in the table root folder using CREATE SCHEMA command and schema usage command is enabled;
b. schema indicated in table function.
This Jira implements point b.
Schema indication using table function is useful when user does not want to persist schema in table root location or when reading from file, not folder.
Schema parameter can be used as individual unit or in together with for format plugin table properties.
V3 reader must be enabled: set `exec.storage.enable_v3_text_reader` = true;
1. There is folder with files or just one file (ex: dfs.tmp.text_table) and user wants to apply schema to them:
a. indicate schema inline:
To indicate only table properties use the following syntax:
b. indicate schema using path:
First schema was created in some location using CREATE SCHEMA command. For example:
Now user wants to apply this schema in table function:
2. User wants to apply schema along side with format plugin table function parameters.
Assuming that user has CSV file with headers with extension that does not comply to default text file with headers extension (ex: cars.csvh-test):
More details about syntax can be found in design document: