[SPARK-18576] Expose basic TaskContext info in PySpark

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: PySpark
• Assignee: Holden Karau
• Reporter: Holden Karau
• Created: 24/Nov/16 10:10
• Updated: 20/Dec/16 23:51
• Resolved: 20/Dec/16 23:51

Description

Currently the TaskContext info isn't exposed in PySpark. While we don't need to expose the full TaskContext information in Python it would make sense to expose the public APIs in Python for users who are doing custom logging or job handling with task id or retry attempt.

Issue Links

• links to: [Github] Pull Request #16211 (holdenk)