Details
-
Bug
-
Status: To Do
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
May want to limit what information is kept. Definitely want to limit what information is kept. Running a large dataset through a workflow a few times can consume significant system resources if all parts of the provenance are logged. Having the option to choose which data to retain after the run is actually preferable to setting it before running the workflow. By default, logging everything is OK if one can save the portions of the provenance data that are needed or desired after the fact, purging the rest. This is executed brilliantly in the Silverback software, which allows users to select the resolution and media inclusion options after they have made a recording, so a user does not accidentally make a run with minimal logging and then realize after the fact that for some reason they should have retained everything, at which point it is simply too late to recapture anything that was not originally recorded.