[CELEBORN-1587] Change to debug logging on client side for SortBasedPusher

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0, 0.5.2
• Labels: pull-request-available
• Assignee: Sanskar Modi
• Reporter: Sanskar Modi
• Created: 06/Sep/24 05:40
• Updated: 06/Sep/24 07:09
• Resolved: 06/Sep/24 07:09

Description

Current SortBasedPusher logging is very noisy 

2024-09-04T14:14:51+05:30 INFO [Executor task launch worker for task 127.0 in stage 24.0 (TID 25529)] SortBasedPusher: Memory used 72.0 MiB exceeds threshold 64.0 MiB, need to trigger push. currentPage size: 64.0 MiB2024-09-04T14:14:51+05:30 INFO [Executor task launch worker for task 127.0 in stage 24.0 (TID 25529)] SortBasedPusher: Memory used 72.0 MiB exceeds threshold 64.0 MiB, need to trigger push. currentPage size: 64.0 MiB2024-09-04T14:14:52+05:30 INFO [Executor task launch worker for task 127.0 in stage 24.0 (TID 25529)] SortBasedPusher: Memory used 72.0 MiB exceeds threshold 64.0 MiB, need to trigger push. currentPage size: 64.0 MiB2024-09-04T14:14:52+05:30 INFO [Executor task launch worker for task 127.0 in stage 24.0 (TID 25529)] SortBasedPusher: Memory used 72.0 MiB exceeds threshold 64.0 MiB, need to trigger push. currentPage size: 64.0 MiB2024-09-04T14:14:52+05:30 INFO [Executor task launch worker for task 127.0 in stage 24.0 (TID 25529)] SortBasedPusher: Memory used 72.0 MiB exceeds threshold 64.0 MiB, need to trigger push. currentPage size: 64.0 MiB2024-09-04T14:14:52+05:30 INFO [Executor task launch worker for task 127.0 in stage 24.0 (TID 25529)] SortBasedPusher: Memory used 72.0 MiB exceeds threshold 64.0 MiB, need to trigger push. currentPage size: 64.0 MiB2024-09-04T14:14:52+05:30 INFO [Executor task launch worker for task 127.0 in stage 24.0 (TID 25529)] SortBasedPusher: Memory used 72.0 MiB exceeds threshold 64.0 MiB, need to trigger push. currentPage size: 64.0 MiB 

Issue Links

• links to: GitHub Pull Request #2728