Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
2.3.0
-
None
Description
In the getBlockData,blockId.reduceId is the Int type, when it is greater than 2^28, blockId.reduceId*8 will overflow.
In the decompress0, len and unitSize are Int type, so len * unitSize may lead to overflow
Attachments
Issue Links
- relates to
-
SPARK-23358 When the number of partitions is greater than 2^28, it will result in an error result
- Resolved
- links to