Current Experiment Results and Raw Data - BASE-LAB-SJTU/CosBench GitHub Wiki
The experimental results based on the current QAset (2020-02-13 updated):
| method | P@3 | MAP@3 | MRR@3 | P@20 | MAP@20 | MRR@20 |
|---|---|---|---|---|---|---|
| Lucene | 0.2821 | 0.0379 | 0.3718 | 0.3042 | 0.1161 | 0.4289 |
| LuSearch | 0.0577 | 0.0058 | 0.0929 | 0.0914 | 0.03 | 0.1151 |
| CodeHow | 0.2628 | 0.0358 | 0.3173 | 0.2794 | 0.1063 | 0.3745 |
| QECK | 0.2244 | 0.0263 | 0.234 | 0.1705 | 0.0645 | 0.2815 |
| YeSearch | 0.0769 | 0.0067 | 0.0994 | 0.1444 | 0.0339 | 0.173 |
| Codenn | 0.2244 | 0.0216 | 0.2885 | 0.205 | 0.0826 | 0.3081 |