[BEAM-7949] Add time-based cache threshold support in the data service of the Python SDK harness

• Type: Sub-task
• Status: Triage Needed
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.19.0
• Component/s: sdk-py-harness
• Assignee: sunjincheng
• Reporter: sunjincheng
• Created: 12/Aug/19 12:08
• Updated: 13/Apr/23 11:00
• Resolved: 25/Dec/19 12:44

Description

Currently only size-based cache threshold is supported in the data service of Python SDK harness. It should also support the time-based cache threshold. This is very important, especially for streaming jobs which are sensitive to the delay. 

Issue Links

• links to: GitHub Pull Request #10246