[SPARK-37876] Move SpecificParquetRecordReaderBase.listDirectory to TestUtils

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Yang Jie
• Reporter: Yang Jie
• Created: 12/Jan/22 09:24
• Updated: 15/Jan/22 15:02
• Resolved: 15/Jan/22 15:02

Description

The `SpecificParquetRecordReaderBase.listDirectory` method is used to return the list of files at `path` recursively and the result will skips files that are ignored normally by MapReduce.

This method is only used by tests in Spark now and it also includes non parquet related test cases, such as `OrcColumnarBatchReaderSuite`.

 

 

 

 

Issue Links

• links to: [Github] Pull Request #35177 (LuciferYang)