-
Type:
Improvement
-
Status: Open
-
Priority:
Minor
-
Resolution: Unresolved
-
Affects Version/s: tools-1.5.3
-
Fix Version/s: None
-
Component/s: Parser
-
Labels:None
ParserEvaluator currently calculates Bracketing FMeasure with no exceptions as to which constituents should be considered. EVALB distributes a set of exceptions in a COLLINS.prm parameter file which are the most commonly used in the literature when evaluating Penn Treebank parsers. These parameters allow to ignore punctuation, trace nodes, etc. to evaluate a parser.
It would be nice to add the functionalities to pass these options to the current implementation of the ParserEvaluator.