[GOBBLIN-1979] Pare down TaskStateCollectorService failure logging, to avoid flooding logs during widespread failure, e.g. O(1k)+

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: gobblin-core
• Assignee: Abhishek Tiwari
• Reporter: Kip Kohn
• Created: 22/Dec/23 14:32
• Updated: 04/Jan/24 17:11
• Resolved: 04/Jan/24 17:11

Description

Logging Task state collector failure at the granularity of every task is impractical, when tasks number in the 100k's.

This arose because the dest-side volume enforced the namespace quota, which left over 100k+ WUs failing. so while not every day, this is a normal occurrence and therefore deserves graceful handling.