I have been trying to list inputFiles that compose my DataSet by using PySpark
.load(S3A_FILESYSTEM_PREFIX + bucket + File.separator + sourceFolderPrefix)
but I get an exception saying inputFiles attribute not present. But I was able to get this functionality with Spark Java.
So is this something missing in PySpark?