Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
1.3.0
-
None
-
java 7 hotspot, spark 1.3.0, ipv6 only cluster
Description
In org.apache.spark.HttpServer uri is generated as
"spark://" + localHostname + ":" + masterPort
, where localHostname is
org.apache.spark.util.Utils.localHostName() = customHostname.getOrElse(localIpAddressHostname)
. If the host has an ipv6 address then it would be interpolated into invalid URI: spark://fe80:0:0:0:200:f8ff:fe21:67cf:42 instead of spark://[fe80:0:0:0:200:f8ff:fe21:67cf]:42.
The solution is to separate uri and hostname entities.