[HDDS-8087] Intermittent crash in TestHddsDatanodeService

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: test
• Labels: pull-request-available
• Target Version/s: 1.4.0
• Assignee: Attila Doroszlai Assign to me
• Reporter: Attila Doroszlai
• Created: 06/Mar/23 12:00
• Updated: 09/Mar/23 14:27
• Resolved: 09/Mar/23 14:26

Description

TestHddsDatanodeService intermittently exits unexpectedly.

https://github.com/apache/ozone/actions/runs/4342532385/jobs/7583465746#step:6:2044

[ERROR] Crashed tests:
[ERROR] org.apache.hadoop.ozone.TestHddsDatanodeService

https://github.com/adoroszlai/ozone-build-results/blob/master/2022/12/05/18851/unit/hadoop-hdds/container-service/org.apache.hadoop.ozone.TestHddsDatanodeService-output.txt

2022-12-05 02:03:53,297 [Datanode State Machine Task Thread - 0] ERROR datanode.InitDatanodeState (InitDatanodeState.java:call(84)) - Failed to get SCM addresses: ozone.scm.names need to be a set of valid DNS names or IP addresses. Empty address list found.
2022-12-05 02:03:53,298 [Datanode State Machine Daemon Thread] ERROR statemachine.StateContext (StateContext.java:execute(675)) - Critical error occurred in StateMachine, setting shutDownMachine
2022-12-05 02:03:53,301 [Datanode State Machine Daemon Thread] ERROR statemachine.DatanodeStateMachine (DatanodeStateMachine.java:startStateMachineThread(334)) - DatanodeStateMachine Shutdown due to an critical error
2022-12-05 02:03:53,302 [Datanode State Machine Daemon Thread] INFO  util.ExitUtil (ExitUtil.java:terminate(210)) - Exiting with status 1: ExitException

• https://github.com/adoroszlai/ozone-build-results/blob/master/2022/10/19/17837/unit/output.log
• https://github.com/adoroszlai/ozone-build-results/blob/master/2022/12/05/18851/unit/output.log

Issue Links

• links to: GitHub Pull Request #4353