Description
uniVocity parser allows to specify only required column names or indexes for parsing like:
// Here we select only the columns by their indexes. // The parser just skips the values in other columns parserSettings.selectIndexes(4, 0, 1); CsvParser parser = new CsvParser(parserSettings);
Need to modify UnivocityParser to extract only needed columns from requiredSchema
Attachments
Issue Links
- is related to
-
SPARK-25134 Csv column pruning with checking of headers throws incorrect error
-
- Resolved
-
- links to
