Details
-
Improvement
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
tools-1.5.3
-
None
-
None
Description
ParserEvaluator currently calculates Bracketing FMeasure with no exceptions as to which constituents should be considered. EVALB distributes a set of exceptions in a COLLINS.prm parameter file which are the most commonly used in the literature when evaluating Penn Treebank parsers. These parameters allow to ignore punctuation, trace nodes, etc. to evaluate a parser.
It would be nice to add the functionalities to pass these options to the current implementation of the ParserEvaluator.