[SPARK-2948] PySpark doesn't work on Python 2.6

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 0.9.3, 1.0.3, 1.1.0
• Component/s: PySpark

Environment

CentOS 6.5 / Python 2.6.6

• Assignee: Josh Rosen
• Reporter: Kousuke Saruta
• Created: 09/Aug/14 20:51
• Updated: 09/Jan/15 17:49
• Resolved: 11/Aug/14 18:55

Description

In serializser.py, collections.namedtuple is redefined as follows.

    def namedtuple(name, fields, verbose=False, rename=False):                                                                                                
        cls = _old_namedtuple(name, fields, verbose, rename)                                                                                                  
        return _hack_namedtuple(cls)                                                                                                                          
                                 

The number of arguments is 4 but the number of arguments of namedtuple for Python 2.6 is 3 so mismatch is occurred.

Issue Links

• links to: [Github] Pull Request #1868 (sarutak)
• links to: [Github] Pull Request #1874 (JoshRosen)