| Change |
Date |
Parse Coverage |
Transfer Coverage |
Generation Coverage |
End-to-End Coverage |
BLEU |
Oracle |
| Initial run |
06/05 |
2779 / 4500 (61.76%) |
549 / 2779 (19.76%) |
383 / 549 (69.76%) |
383 / 4500 (8.51%) |
0.1433 |
0.2234 |
| Fixed _eba_c_rel etc. |
06/07 |
2779 / 4500 (61.76%) |
662 / 2779 (23.82%) |
478 / 662 (72.21%) |
478 / 4500 (10.62%) |
0.1436 |
0.2302 |
| Rel name debugging + handcrafted rules |
06/09 |
2779 / 4500 (61.76%) |
679 / 2779 (24.43%) |
487 / 679 (71.72%) |
487 / 4500 (10.82%) |
0.1470 |
0.2335 |
| Generic entries w/o にる,だける |
06/14 |
3014 / 4500 (66.98%) |
691 / 3014 (22.93%) |
491 / 691 (71.06%) |
491 / 4500 (10.91%) |
0.1404 |
0.2300 |
| New vn handling |
06/14 |
3014 / 4500 (66.98%) |
703 / 3014 (23.32%) |
500 / 703 (71.12%) |
500 / 4500 (11.11%) |
0.1369 |
0.2264 |
| Generic Edict rules |
06/15 |
3014 / 4500 (66.98%) |
722 / 3014 (23.95%) |
520 / 722 (72.02%) |
520 / 4500 (11.56%) |
0.1337 |
0.2231 |
| Removed _ga_5_rel,_iru_6_rel,_iru_7_rel; fixed conjunction_mtr |
06/15 |
3068 / 4500 (68.18%) |
777 / 3068 (25.33%) |
528 / 777 (67.95%) |
528 / 4500 (11.73%) |
0.1336 |
0.2232 |