Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
2.3.0
Description
ChunkedByteBuffer.writeFully method has not reset the limit value. When
chunks larger than bufferWriteChunkSize, such as 80*1024*1024 larger than
config.BUFFER_WRITE_CHUNK_SIZE(64 * 1024 * 1024),only while once, will lost 16*1024*1024 byte
Attachments
Issue Links
- is caused by
-
SPARK-21527 Use buffer limit in order to take advantage of JAVA NIO Util's buffercache
- Resolved
- links to