Milestone 3 Performance Report - 11791-04/project-team04 GitHub Wiki

Baseline System

MAP Scores

  • RESULTS doc: 0.09131988937956696
  • RESULTS concept: 0.20532038335922262
  • RESULTS triples: 0.0

GMAP Scores (epsilon: 0.01)

  • RESULTS doc: 0.019297875014315694
  • RESULTS concept: 0.037908395544034516
  • RESULTS triples: 0.01

Improved System [Improvements over Milestone 2]

Techniques performed:

  • Ranking documents with 1) a stop word list, 2) the krovetze stemmer and 3) the Indri ranker.
  • Using the "Year" hack to improve concepts retrieval.
  • Partial evaluation for Triples.

MAP Scores

  • RESULTS doc: 0.19237429507324239
  • RESULTS concept: 0.4056179950691689
  • RESULTS triples: 0.011900456189311532

GMAP Scores (epsilon: 0.01)

  • RESULTS doc: 0.03411011970855284
  • RESULTS concept: 0.26979728228416805
  • RESULTS triples: 0.013384083946632484

List Q/A Results

Number of LIST QUESTIONS: 8

  • LIST Mean P: 0.005387205

  • LIST Mean R: 0.1875

  • LIST Mean F1: 0.010126714

  • LIST Mean Soft P: 0.06997054

  • LIST Mean Soft R: 0.25

  • LIST Mean Soft F1: 0.063157015

Add a custom footer
⚠️ **GitHub.com Fallback** ⚠️