[SPARK-4475] PySpark failed to initialize if localhost can not be resolved

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.0.2, 1.1.0, 1.2.0
• Component/s: PySpark
• Assignee: Unassigned
• Reporter: Davies Liu
• Created: 18/Nov/14 19:19
• Updated: 26/Feb/15 21:52
• Resolved: 26/Feb/15 21:52

Description

Traceback (most recent call last):
  File "/home/hduser/Downloads/spark-1.1.0/python/pyspark/shell.py", line 44, in <module>
    sc = SparkContext(appName="PySparkShell", pyFiles=add_files)
  File "/home/hduser/Downloads/spark-1.1.0/python/pyspark/context.py", line 107, in __init__
    conf)
  File "/home/hduser/Downloads/spark-1.1.0/python/pyspark/context.py", line 159, in _do_init
    self._accumulatorServer = accumulators._start_update_server()
  File "/home/hduser/Downloads/spark-1.1.0/python/pyspark/accumulators.py", line 251, in _start_update_server
    server = AccumulatorServer(("localhost", 0), _UpdateRequestHandler)
  File "/usr/lib/python2.7/SocketServer.py", line 408, in __init__
    self.server_bind()
  File "/usr/lib/python2.7/SocketServer.py", line 419, in server_bind
    self.socket.bind(self.server_address)
  File "/usr/lib/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
socket.gaierror: [Errno -5] No address associated with hostname

Issue Links

• links to: [Github] Pull Request #3425 (lvsoft)