[BEAM-14362] Add flag to drop example from PredicitonResult

• Type: Sub-task
• Status: Open
• Priority: P2
• Resolution: Unresolved
• Component/s: sdk-py-core
• Labels: run-inference
• Assignee: Unassigned
• Reporter: Andy Ye
• Created: 25/Apr/22 15:39
• Updated: 04/Jun/22 23:31

Description

RunInference currently returns both the example/input and prediction. 

PredictionResult:
  example: torch(...)
  inference: torch(...)

Users may want the ability to only return the inference to minimize potential memory/serialization issues later in the pipeline. They can do this with a flag, and the return value may look like

PredictionResult:
  example: None
  inference: torch(...)