Package: metrics - 11791-04/project-team04 GitHub Wiki
-
Set Method:
register(ArrayList<String> retriedAnswers, ArrayList<String> goldStandards)- Register a pair of gold standard answers and our candidate answers
-
Get Methods:
strictAccuracy(), lenientAccuracy(), mrr(), p(), r(), f1(), softP(), softR(), softF1(), total()- Obtained the evaluation results of all previously registers results.
See the "ExactMatchConsumer" Section in the "Package: descriptorimpl" page for detail.
Abstract class for metric storing and evaluation
-
Set Method:
public void registerAnswerAndGoldStandard(List<T> answer, List<T> gold)- Register a list of gold standard answers and our candidate answers
-
Get Methods:
getCurrentMAP(), getCurrentGMAP(double epsilon), getCurrentF1()- Obtained the evaluation results of all previously registered results
Metric evaluation class for Documents and Concepts (Extends MetricBasic)
Metric evaluation class for Triples (Extends MetricBasic)
Metric evaluation class for Snippets (Extends MetricBasic)