[CELEBORN-1705] Disk buffer size is negative

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.5.1
• Fix Version/s: 0.6.0, 0.5.3
• Labels: pull-request-available
• Assignee: Fei Wang
• Reporter: Fei Wang
• Created: 09/Nov/24 18:56
• Updated: 14/Nov/24 08:18
• Resolved: 14/Nov/24 06:25

Description

Log:

24/11/09 23:30:50,474 INFO [worker-memory-manager-reporter] MemoryManager: Direct memory usage: 276.0 MiB/40.0 GiB, disk buffer size: -748726.0 B, sort memory size: 0.0 B, read buffer size: 0.0 B, memory file storage size : 731.2 KiB

 

Metrics

metrics_DiskBuffer_Value{instance="hdc42-mcc10-01-0210-5910-037-tess0131.stratus.rno.ebay.com:8080",role="worker"} -748726 1731220505547
metrics_MemoryFileStorageSize_Value{instance="hdc42-mcc10-01-0210-5910-037-tess0131.stratus.rno.ebay.com:8080",role="worker"} 748726 1731220505549

 

After all shuffle expired:

metrics_DiskBuffer_Value + metrics_MemoryFileStorageSize_Value = 0

 

Issue Links

• links to: Github PR
• links to: GitHub Pull Request #2916
• links to: GitHub Pull Request #2919