[PARQUET-2331] Allow convert-csv to take multiple input files

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Component/s: parquet-cli
• Assignee: Kengo Seki
• Reporter: Kengo Seki
• Created: 03/Aug/23 22:44
• Updated: 23/Jun/24 03:33
• Resolved: 09/Aug/23 15:03

Description

Recently, I had to merge many CSV files into a Parquet file. parquet-cli's convert-csv only takes one CSV file, while rewrite takes multiple Parquet (or Avro) files. So I first converted CSVs into Parquets with convert-csv one by one, then merge them into one file using rewrite.
I think it'd be useful if convert-csv itself had such a merging feature.