Major Description
Currently PrequentialEvaluation task supports dumpFile option. With this option model performance can be saved to a file. However, in some cases it would be good to save also individual predictions made by a model. This is useful for model debugging and method development.
This could be also used to visualize model output, calculate custom performance indicators (e.g. model accuracy for instances of a certain class or sharing the same feature value). Such saving of model output (if done) should be made for every instance. Hence, a new option making it possible to dump predictions to a separate file seems justified. For classification, it should include votes made for individual classes, if available.
Attachments
Issue Links
- links to
