Details
-
Documentation
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
3.3.1
-
None
Description
The path argument of pyspark.pandas.read_csv(path, ...) currently has type annotation str and is documented as
path : str
The path string storing the CSV file to be read.
The implementation however uses pyspark.sql.DataFrameReader.csv(path, ...) which does support multiple paths:
path : str or list
string, or list of strings, for input path(s),
or RDD of Strings storing CSV rows.
Loading multiple CSV files at once is a useful feature to have and should be documented (and tested for)
