[SPARK-27428] Test "metrics StatsD sink with Timer " fails on BigEndian

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.2, 2.3.3, 2.3.4
• Fix Version/s: 3.0.2, 3.1.0
• Component/s: Spark Core
• Labels: BigEndian

Environment

Working on Ubuntu16.04, Linux 

Java versions : 

Eclipse OpenJ9 VM (build openj9-0.12.1, JRE 1.8.0 Linux s390x-64-Bit Compressed References 20190205_218 (JIT enabled, AOT enabled)

and

openjdk version "1.8.0_191"
OpenJDK Runtime Environment (build 1.8.0_191-8u191-b12-2ubuntu0.18.04.1-b12)
OpenJDK 64-Bit Zero VM (build 25.191-b12, interpreted mode)

• Assignee: Michael Munday
• Reporter: Anuja Jakhade
• Created: 10/Apr/19 10:58
• Updated: 12/Dec/22 18:10
• Resolved: 06/Oct/20 13:31

Description

Test case "metrics StatsD sink with Timer *** FAILED ***" fails with error

java.net.SocketTimeoutException: Receive timed out
at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:143)
at java.net.DatagramSocket.receive(DatagramSocket.java:812)
at org.apache.spark.metrics.sink.StatsdSinkSuite$$anonfun$4$$anonfun$apply$mcV$sp$4$$anonfun$apply$3.apply(StatsdSinkSuite.scala:155)
at org.apache.spark.metrics.sink.StatsdSinkSuite$$anonfun$4$$anonfun$apply$mcV$sp$4$$anonfun$apply$3.apply(StatsdSinkSuite.scala:154)
at scala.collection.immutable.Range.foreach(Range.scala:160)
at org.apache.spark.metrics.sink.StatsdSinkSuite$$anonfun$4$$anonfun$apply$mcV$sp$4.apply(StatsdSinkSuite.scala:154)
at org.apache.spark.metrics.sink.StatsdSinkSuite$$anonfun$4$$anonfun$apply$mcV$sp$4.apply(StatsdSinkSuite.scala:123)
at org.apache.spark.metrics.sink.StatsdSinkSuite.org$apache$spark$metrics$sink$StatsdSinkSuite$$withSocketAndSink(StatsdSinkSuite.scala:51)
at org.apache.spark.metrics.sink.StatsdSinkSuite$$anonfun$4.apply$mcV$sp(StatsdSinkSuite.scala:123)
at org.apache.spark.metrics.sink.StatsdSinkSuite$$anonfun$4.apply(StatsdSinkSuite.scala:123)

On debugging observed that the last packet is not received at "socket.receive(p)". Hence the assert fails.  

 

Also I want to know, which feature of Apache Spark is tested in this this test.

Issue Links

• links to: [Github] Pull Request #29819 (mundaym)