[SPARK-2627] Check for PEP 8 compliance on all Python code in the Jenkins CI cycle

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Build
• Assignee: Nicholas Chammas
• Reporter: Nicholas Chammas
• Created: 22/Jul/14 19:49
• Updated: 03/Sep/14 03:16
• Resolved: 06/Aug/14 21:54

Description

This issue was triggered by the discussion here.

Requirements:

• make a linter script for Scala under dev/lint-scala that just calls scalastyle
• make a linter script for Python under dev/lint-python that calls pep8 on all Python files
  • One exception to this is cloudpickle.py, which is a third-party module we don't want to touch
• Modify dev/run-tests to call both linter scripts
• Incorporate these changes into the Contributing to Spark guide

Issue Links

• relates to: SPARK-2470 Fix PEP 8 violations
• links to: [Github] Pull Request #1744 (nchammas)
• links to: Contributing to Spark Guide

Sub-Tasks

• Expand PEP 8 checks to include EC2 script and Python examples: Resolved