[SAMOA-68] Saving true and predicted labels to file - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Done
Priority: Major
Resolution: Done
Component/s: SAMOA-API
Labels:
- features

Description

Currently PrequentialEvaluation task supports dumpFile option. With this option model performance can be saved to a file. However, in some cases it would be good to save also individual predictions made by a model. This is useful for model debugging and method development.
This could be also used to visualize model output, calculate custom performance indicators (e.g. model accuracy for instances of a certain class or sharing the same feature value). Such saving of model output (if done) should be made for every instance. Hence, a new option making it possible to dump predictions to a separate file seems justified. For classification, it should include votes made for individual classes, if available.