[SPARK-35986] fix pyspark.rdd.RDD.histogram's buckets argument

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.0.1, 3.0.2, 3.0.3, 3.1.0, 3.1.1, 3.1.2
• Fix Version/s: 3.2.0, 3.1.3, 3.3.0
• Component/s: PySpark
• Labels: PySpark pyspark stubs
• External issue URL: https://github.com/zero323/pyspark-stubs/issues/548
• Assignee: Tomas Pereira de Vasconcelos
• Reporter: Tomas Pereira de Vasconcelos
• Shepherd: Maciej Szymkiewicz
• Created: 02/Jul/21 08:25
• Updated: 12/Dec/22 18:10
• Resolved: 04/Jul/21 01:24

Description

I originally opened an issue and created a PR in the https://github.com/zero323/pyspark-stubs repository.

Issue: https://github.com/zero323/pyspark-stubs/issues/548

PR: https://github.com/zero323/pyspark-stubs/pull/549

—

The type hint for pyspark.rdd.RDD.histogram's buckets argument should be Union[int, List[T], Tuple[T, ...]]

From pyspark source:

if isinstance(buckets, int):
    ...
elif isinstance(buckets, (list, tuple)):
    ...
else:
    raise TypeError("buckets should be a list or tuple or number(int or long)")

Issue Links

• links to: [Github] Pull Request #33185 (tpvasconcelos)