[BEAM-5428] Implement cross-bundle state caching.

• Type: Improvement
• Status: Triage Needed
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.17.0
• Component/s: sdk-py-harness
• Assignee: Maximilian Michels
• Reporter: Robert Bradshaw
• Created: 19/Sep/18 08:06
• Updated: 13/Apr/23 10:57
• Resolved: 03/Oct/19 10:57

Description

Tech spec: https://docs.google.com/document/d/1BOozW0bzBuz4oHJEuZNDOHdzaV5Y56ix58Ozrqm2jFg/edit#heading=h.7ghoih5aig5m

Relevant document: https://docs.google.com/document/d/1ltVqIW0XxUXI6grp17TgeyIybk3-nDF8a0-Nqw-s9mY/edit#

Mailing list link: https://lists.apache.org/thread.html/caa8d9bc6ca871d13de2c5e6ba07fdc76f85d26497d95d90893aa1f6@%3Cdev.beam.apache.org%3E

Issue Links

• Is contained by: BEAM-7944 Improvements of portability framework to make it usable in other projects
• is related to: BEAM-8297 Evict state cache based on an upper memory limit
• is related to: BEAM-8298 Implement state caching for side inputs for Python
• links to: GitHub Pull Request #9374
• links to: GitHub Pull Request #9418
• links to: GitHub Pull Request #9440
• links to: GitHub Pull Request #9459