Leaderboard

Model AVG - EN AVG
XLMR-Large 65.66 66.82
XLMR-Base 64.82 65.87
MBERT 62.84 63.88
EWISER 62.16 63.38
SyntagRank 57.68 59.02
Babelfy 52.85 54.01
MCS 49.31 50.85

Language Breakdown

Model BG CA DA DE EN
XLMR-Large 72.00 49.97 80.61 83.18 76.28
XLMR-Base 71.59 47.77 79.18 82.13 74.50
MBERT 68.78 47.35 76.04 80.63 72.40
EWISER 68.64 42.99 76.67 80.86 73.28
SyntagRank 61.10 43.98 72.93 75.99 69.96
Babelfy 60.39 36.52 71.33 77.84 64.09
MCS 58.16 27.17 64.33 75.99 63.37