[HUDI-616] Parquet files not getting created on DFS docker instance but on local FS in TestHoodieDeltaStreamer

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0, 0.5.3
• Component/s: deltastreamer, Testing, tests-ci
• Labels: pull-request-available
• Assignee: Pratyaksh Sharma
• Reporter: Pratyaksh Sharma
• Created: 17/Feb/20 17:11
• Updated: 27/Mar/22 15:00
• Resolved: 22/Mar/20 14:21

Description

In TestHoodieDeltaStreamer, 

PARQUET_SOURCE_ROOT gets initialised even before function annotated with @BeforeClass gets called as below - 

private static final String PARQUET_SOURCE_ROOT = dfsBasePath + "/parquetFiles";

At this point, dfsBasePath variable is null and as a result, parquet files get created on local FS which need to be cleared manually after testing. This needs to be rectified.

Issue Links

• links to: GitHub Pull Request #1434