Re evaluation - JulianThijssen/TelegraafES GitHub Wiki
In this re-evaluation run we change the ranking by making the query terms mandatory, but changing the boolean operator to "OR". We also filter out advertisements as they contain no information.
<topic number="1">
<query>vluchtelingen vietnam</query>
<description>Informatie over vietnamese vluchtelingen in Thailand</description>
</topic>
Judge 1: N N N N R N N R N N
Judge 2: N N N N N N N R N R
Pave(J1): 0.23 (before 0.53)
Pave(J2): 0.1625 (before 0.40)
<topic number="2">
<query>tweede wereld oorlog</query>
<description>Informatie over Tweede Wereld Oorlog</description>
</topic>
Judge 1: N N R R R N R N N N
Judge 2: N N N R R N N N N N
Pave(J1): 0.50 (before 1.0)
Pave(J2): 0.325 (before 0.325)
<topic number="3">
<query>vogeltrek</query>
<description>Informatie over de vogeltrek in Nederland</description>
</topic>
Judge 1: N R N N N R R N R R
Judge 2: N N N N N N R N R R
Pave(J1): 0.44 (before 0.75)
Pave(J2): 0.22 (before 0.44)
<topic number="4">
<query>griep</query>
<description>Informatie over griep in Nederland</description>
</topic>
Judge 1: N N R N N R N N N N
Judge 2: N N R N N N N N N N
Pave(J1): 0.33 (before 0.0)
Pave(J2): 0.33 (before 0.0)
<topic number="5">
<query>terrorisme bestrijding</query>
<description>Informatie over terrorisme bestrijding in Nederland</description>
</topic>
Judge 1: R N N R N R R R N R
Judge 2: N N N R N R N N N R
Pave(J1): 0.63 (before 0.81)
Pave(J2): 0.29 (before 0.53)