[HUDI-1950] Azure CI unit tests fail with connection refused

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Component/s: Testing, tests-ci
• Labels: pull-request-available
• Assignee: Shiyan Xu
• Reporter: Shiyan Xu
• Created: 31/May/21 16:13
• Updated: 27/Mar/22 15:00
• Resolved: 15/Jun/21 10:46

Description

Have seen the same issue with different unit tests. When a test init an HDFS and tries to perform file delete, it throws similar error as below

java.net.ConnectException: Call From fv-az48-966/10.1.0.14 to localhost:35955 failed on connection exception: java.net.ConnectException: Connection refused

 

An example run 

https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=134&view=logs&j=d3721143-1417-5e3d-cf04-c39c0756eab9

 

Tried suggestions from 

https://stackoverflow.com/questions/28661285/hadoop-cluster-setup-java-net-connectexception-connection-refused

https://cwiki.apache.org/confluence/display/HADOOP2/ConnectionRefused

but no luck.

 

Pushing to this branch https://github.com/apache/hudi/pull/2984/files will trigger new run in this pipeline https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build?definitionId=5&_a=summary 

Issue Links

• is depended upon by: HUDI-1251 [UMBRELLA] Migrate CI to azure
• links to: GitHub Pull Request #2984
• links to: GitHub Pull Request #3043