[HDDS-782] MR example pi job runs 5 min for 1 Map/1 Sample

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 0.3.0
• Component/s: Ozone Filesystem
• Target Version/s: 1.4.0
• Assignee: Unassigned
• Reporter: Soumitra Sulav
• Created: 31/Oct/18 21:29
• Updated: 16/Aug/23 18:22
• Resolved: 16/Aug/23 15:05

Description

On running a hadoop examples pi job it takes 250+ seconds which generally run in few seconds in HDFS cluster.

On seeing the service/job logs it seems that there are few SocketTimeoutException in between and YARN keeps on Waiting for AsyncDispatcher to drain. Thread state is WAITING for a very long interval.

 

Refer attached log for further details.