funded by the European Commission under Framework Programme 6
| Annotator | Judged | Time (hhh:mm:ss) | Sec / Judgement |
|---|---|---|---|
| cam | 566 | 07:16:41 | 46.29 |
| jesus | 560 | 08:08:36 | 52.35 |
| Vassilina | 543 | 07:41:19 | 50.97 |
| zwang | 518 | 07:53:25 | 54.84 |
| ccb | 464 | 06:18:55 | 49.00 |
| klimes | 371 | 05:46:32 | 56.04 |
| cfedermann | 361 | 04:35:29 | 45.79 |
| sara | 355 | 05:03:59 | 51.38 |
| AW | 352 | 05:06:17 | 52.21 |
| jfaulkner | 341 | 04:39:03 | 49.10 |
| ghannema | 330 | 05:03:31 | 55.18 |
| arosti | 320 | 03:57:33 | 44.54 |
| loic | 312 | 04:31:04 | 52.13 |
| micha | 300 | 04:47:43 | 57.54 |
| nakov | 295 | 05:15:41 | 64.21 |
| amit tai | 285 | 04:00:54 | 50.72 |
| obo | 276 | 05:51:10 | 76.34 |
| andreas | 262 | 04:02:28 | 55.53 |
| teresa | 261 | 04:43:42 | 65.22 |
| kgimpel | 252 | 04:16:18 | 61.02 |
| cg | 251 | 04:15:20 | 61.04 |
| UPC-TALP | 250 | 04:22:33 | 63.01 |
| DCU | 250 | 03:08:31 | 45.24 |
| annette | 243 | 04:21:51 | 64.65 |
| sh | 240 | 02:14:53 | 33.72 |
| dan | 224 | 04:37:06 | 74.22 |
| ad465 | 202 | 02:41:20 | 47.92 |
| hwa | 200 | 03:14:10 | 58.25 |
| lopez | 200 | 03:22:01 | 60.60 |
| lah | 190 | 02:41:55 | 51.13 |
| zdenek | 181 | 03:09:50 | 62.93 |
| nguyen | 180 | 02:36:37 | 52.21 |
| gwb24 | 175 | 02:47:37 | 57.47 |
| vendula | 154 | 05:30:10 | 128.64 |
| johanka | 154 | 01:19:01 | 30.79 |
| spousta | 152 | 02:05:02 | 49.36 |
| gadda | 151 | 02:22:58 | 56.81 |
| lingvik | 150 | 01:54:05 | 45.63 |
| jamie | 150 | 01:57:53 | 47.15 |
| saintamh | 150 | 01:40:14 | 40.09 |
| hlava | 150 | 01:56:46 | 46.71 |
| holger | 150 | 02:02:07 | 48.85 |
| marsh | 144 | 02:32:28 | 63.53 |
| ptacek | 140 | 01:55:21 | 49.44 |
| kveton | 140 | 02:08:01 | 54.86 |
| marho | 138 | 02:14:51 | 58.63 |
| hg | 131 | 04:42:35 | 129.43 |
| sleza | 129 | 03:14:07 | 90.29 |
| alejandra | 110 | 03:45:24 | 122.95 |
| novak | 106 | 01:56:00 | 65.66 |
| anovak | 105 | 01:07:37 | 38.64 |
| ilaria | 105 | 04:48:38 | 164.93 |
| dbr | 102 | 01:42:52 | 60.51 |
| Leda | 102 | 04:18:12 | 151.88 |
| jean2 | 101 | 01:02:44 | 37.27 |
| mip | 100 | 02:28:28 | 89.08 |
| galibert | 100 | 01:37:39 | 58.59 |
| Martin | 100 | 02:15:06 | 81.06 |
| brus | 100 | 02:26:38 | 87.98 |
| alicia | 100 | 02:24:11 | 86.51 |
| rosset | 100 | 01:13:50 | 44.30 |
| raab | 100 | 01:37:24 | 58.44 |
| kolo | 100 | 01:52:12 | 67.32 |
| tynovsky | 100 | 02:39:25 | 95.65 |
| shacker | 100 | 01:56:22 | 69.82 |
| prokopova | 100 | 01:50:16 | 66.16 |
| alopez | 90 | 01:32:24 | 61.60 |
| dan-test | 90 | 00:13:07 | 8.74 |
| ozaidan | 90 | 01:20:04 | 53.38 |
| GinaB | 90 | 00:45:06 | 30.07 |
| jaclyn | 81 | 01:17:13 | 57.20 |
| kevin | 70 | 01:07:40 | 58.00 |
| adolfo | 70 | 01:08:56 | 59.09 |
| vkolo11 | 66 | 01:37:44 | 88.85 |
| jgk | 64 | 01:11:43 | 67.23 |
| CB | 62 | 01:17:46 | 75.26 |
| sseljan | 56 | 01:02:16 | 66.71 |
| beroth | 54 | 01:23:53 | 93.20 |
| kduh | 54 | 00:40:46 | 45.30 |
| aurelien | 51 | 00:50:18 | 59.18 |
| ebadat | 51 | 00:30:00 | 35.29 |
| maxj | 51 | 01:07:08 | 78.98 |
| natalka | 51 | 01:40:41 | 118.45 |
| mtietze | 51 | 01:09:21 | 81.59 |
| Katie | 51 | 00:56:22 | 66.31 |
| kurtdt | 50 | 01:09:11 | 83.02 |
| carloshq | 50 | 01:02:15 | 74.70 |
| jmcrego | 50 | 00:29:44 | 35.68 |
| lm | 50 | 00:56:47 | 68.14 |
| Anselm | 50 | 00:46:30 | 55.80 |
| allauzen | 50 | 00:48:27 | 58.14 |
| mattt | 50 | 00:29:17 | 35.14 |
| clare | 50 | 02:48:46 | 202.52 |
| yvon | 50 | 00:51:32 | 61.84 |
| hbm | 50 | 01:14:01 | 88.82 |
| JaSi | 50 | 00:31:46 | 38.12 |
| christof | 50 | 00:40:49 | 48.98 |
| simon | 48 | 00:55:33 | 69.44 |
| ben | 45 | 00:52:49 | 70.42 |
| cdb | 45 | 01:12:26 | 96.58 |
| sadaf | 44 | 01:12:03 | 98.25 |
| emcconvi | 40 | 00:27:18 | 40.95 |
| bittor | 40 | 01:14:16 | 111.40 |
| eshao | 40 | 00:16:44 | 25.10 |
| mheilman | 40 | 00:44:30 | 66.75 |
| handre | 38 | 00:56:19 | 88.92 |
| marianna | 37 | 01:16:44 | 124.43 |
| phi | 36 | 00:41:38 | 69.39 |
| koenvw | 36 | 01:09:18 | 115.50 |
| bb | 36 | 00:34:06 | 56.83 |
| johann | 33 | 01:15:40 | 137.58 |
| kp | 32 | 00:27:54 | 52.31 |
| madda | 30 | 00:50:38 | 101.27 |
| torsten | 30 | 00:58:53 | 117.77 |
| rdufour | 29 | 00:30:14 | 62.55 |
| hilario | 28 | 00:39:08 | 83.86 |
| saiqian | 28 | 00:31:36 | 67.71 |
| pajada | 27 | 00:32:39 | 72.56 |
| mdreyer | 27 | 00:43:46 | 97.26 |
| mared3am | 26 | 00:31:34 | 72.85 |
| ch | 26 | 00:30:44 | 70.92 |
| skl | 26 | 00:38:07 | 87.96 |
| royt | 26 | 00:39:37 | 91.42 |
| delip | 25 | 00:37:03 | 88.92 |
| mushu | 24 | 00:41:29 | 103.71 |
| sharder | 22 | 00:38:15 | 104.32 |
| jaasa | 21 | 00:22:09 | 63.29 |
| yesteve | 20 | 00:26:18 | 78.90 |
| yoshi | 19 | 00:32:24 | 102.32 |
| lori | 17 | 00:20:17 | 71.59 |
| rabauti | 16 | 00:48:52 | 183.25 |
| aceausu | 15 | 00:32:13 | 128.87 |
| Harrison | 14 | 00:42:26 | 181.86 |
| ctill | 13 | 00:09:54 | 45.69 |
| kwilson | 9 | 00:11:16 | 75.11 |
| chico | 8 | 00:13:19 | 99.88 |
| zi | 7 | 00:24:05 | 206.43 |
| ccc | 7 | 00:10:43 | 91.86 |
| Zahruul | 7 | 00:14:41 | 125.86 |
| ehuber | 6 | 00:13:06 | 131.00 |
| dft | 6 | 00:11:47 | 117.83 |
| jean | 5 | 00:07:44 | 92.80 |
| stewama | 4 | 00:04:27 | 66.75 |
| nist | 3 | 00:11:04 | 221.33 |
| bocage | 2 | 00:03:32 | 106.00 |
| Steven | 2 | 00:05:40 | 170.00 |
| DaGiampi | 1 | 00:05:00 | 300.00 |
| jason | 1 | 00:02:22 | 142.00 |
| TOTAL | 17134 | 292:28:34 | 61.45 |
| Task | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| WMT08 All-English News | 0 | 0 | 5282 |
| WMT08 Czech-English Commentary | 0 | 0 | 1747 |
| WMT08 Czech-English News | 0 | 0 | 1480 |
| WMT08 English-Czech Commentary | 1588 | 1857 | 932 |
| WMT08 English-Czech News | 1951 | 2101 | 1067 |
| WMT08 English-French Europarl | 1289 | 1346 | 714 |
| WMT08 English-French News | 1758 | 1930 | 968 |
| WMT08 English-German Europarl | 1954 | 2137 | 1054 |
| WMT08 English-German News | 2258 | 2444 | 1245 |
| WMT08 English-Spanish Europarl | 1304 | 1358 | 694 |
| WMT08 English-Spanish News | 1475 | 1516 | 755 |
| WMT08 French-English Europarl | 1962 | 2001 | 1013 |
| WMT08 French-English News | 2830 | 2974 | 1559 |
| WMT08 German-English Europarl | 1560 | 1750 | 834 |
| WMT08 German-English News | 1915 | 2098 | 1062 |
| WMT08 Hungarian-English News | 0 | 0 | 1085 |
| WMT08 Spanish-English Europarl | 1898 | 1855 | 993 |
| WMT08 Spanish-English News | 1931 | 2212 | 1055 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| bbn-combo_fr | 0.0 (0) | 0.0 (0) | -2.57 (114) | 114 |
| saar-contrast_de | 0.0 (0) | 0.0 (0) | -3.00 (130) | 130 |
| rbmt3_fr | 0.0 (0) | 0.0 (0) | -2.85 (124) | 124 |
| saar_es | 0.0 (0) | 0.0 (0) | -2.62 (133) | 133 |
| limsi_es | 0.0 (0) | 0.0 (0) | -3.10 (101) | 101 |
| cued_es | 0.0 (0) | 0.0 (0) | -2.99 (114) | 114 |
| limsi_fr | 0.0 (0) | 0.0 (0) | -2.58 (125) | 125 |
| rbmt2_de | 0.0 (0) | 0.0 (0) | -2.75 (131) | 131 |
| rbmt3_de | 0.0 (0) | 0.0 (0) | -3.03 (120) | 120 |
| saar-contrast_fr | 0.0 (0) | 0.0 (0) | -2.76 (112) | 112 |
| rbmt5_fr | 0.0 (0) | 0.0 (0) | -2.45 (121) | 121 |
| ucb_es | 0.0 (0) | 0.0 (0) | -3.07 (109) | 109 |
| cmu-combo_fr | 0.0 (0) | 0.0 (0) | -2.76 (120) | 120 |
| rbmt6_fr | 0.0 (0) | 0.0 (0) | -2.84 (116) | 116 |
| saar_fr | 0.0 (0) | 0.0 (0) | -2.96 (132) | 132 |
| rbmt4_es | 0.0 (0) | 0.0 (0) | -2.56 (116) | 116 |
| rbmt6_es | 0.0 (0) | 0.0 (0) | -2.83 (110) | 110 |
| cued_fr | 0.0 (0) | 0.0 (0) | -2.70 (121) | 121 |
| lium-systran-contrast_fr | 0.0 (0) | 0.0 (0) | -2.46 (127) | 127 |
| liu_de | 0.0 (0) | 0.0 (0) | -3.46 (97) | 97 |
| rbmt4_de | 0.0 (0) | 0.0 (0) | -2.90 (111) | 111 |
| uedin_fr | 0.0 (0) | 0.0 (0) | -2.84 (119) | 119 |
| bbn-combo_de | 0.0 (0) | 0.0 (0) | -3.56 (100) | 100 |
| upc_es | 0.0 (0) | 0.0 (0) | -2.70 (115) | 115 |
| dcu_cz | 0.0 (0) | 0.0 (0) | -3.61 (122) | 122 |
| uedin_es | 0.0 (0) | 0.0 (0) | -2.76 (116) | 116 |
| rbmt3_es | 0.0 (0) | 0.0 (0) | -2.67 (123) | 123 |
| uedin_de | 0.0 (0) | 0.0 (0) | -3.41 (103) | 103 |
| cmu-statxfer_fr | 0.0 (0) | 0.0 (0) | -3.28 (94) | 94 |
| rbmt5_de | 0.0 (0) | 0.0 (0) | -3.31 (116) | 116 |
| umd_cz | 0.0 (0) | 0.0 (0) | -3.53 (112) | 112 |
| rbmt4_fr | 0.0 (0) | 0.0 (0) | -2.70 (117) | 117 |
| rbmt6_de | 0.0 (0) | 0.0 (0) | -3.24 (126) | 126 |
| cued-contrast_es | 0.0 (0) | 0.0 (0) | -2.70 (128) | 128 |
| uedin_cz | 0.0 (0) | 0.0 (0) | -3.95 (114) | 114 |
| lium-systran_fr | 0.0 (0) | 0.0 (0) | -2.47 (126) | 126 |
| limsi_de | 0.0 (0) | 0.0 (0) | -3.42 (109) | 109 |
| cued-contrast_fr | 0.0 (0) | 0.0 (0) | -2.67 (128) | 128 |
| rbmt5_es | 0.0 (0) | 0.0 (0) | -2.88 (126) | 126 |
| cmu-statxfer_de | 0.0 (0) | 0.0 (0) | -3.97 (118) | 118 |
| saar_de | 0.0 (0) | 0.0 (0) | -3.41 (140) | 140 |
| cmu-smt_es | 0.0 (0) | 0.0 (0) | -3.11 (114) | 114 |
| uedin_hu | 0.0 (0) | 0.0 (0) | -4.30 (77) | 77 |
| morphologic_hu | 0.0 (0) | 0.0 (0) | -3.62 (74) | 74 |
| uedin-combo_fr | 0.0 (0) | 0.0 (0) | -2.62 (54) | 54 |
| uedin-combo_xx | 0.0 (0) | 0.0 (0) | -2.30 (63) | 63 |
| uedin-combo_de | 0.0 (0) | 0.0 (0) | -3.73 (64) | 64 |
| TOTAL | 0 | 0 | 5,282 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| dcu | 0.0 (0) | 0.0 (0) | -2.70 (436) | 436 |
| systran | 0.0 (0) | 0.0 (0) | -3.51 (438) | 438 |
| umd | 0.0 (0) | 0.0 (0) | -2.68 (437) | 437 |
| uedin | 0.0 (0) | 0.0 (0) | -3.12 (436) | 436 |
| TOTAL | 0 | 0 | 1,747 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| umd | 0.0 (0) | 0.0 (0) | -2.93 (494) | 494 |
| uedin | 0.0 (0) | 0.0 (0) | -3.15 (493) | 493 |
| dcu | 0.0 (0) | 0.0 (0) | -2.91 (493) | 493 |
| TOTAL | 0 | 0 | 1,480 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| uedin | 0.41 (413) | -3.04 (485) | -3.33 (243) | 1141 |
| cu-bojar | 0.59 (409) | -2.72 (464) | -2.62 (233) | 1106 |
| pc-translator | 0.51 (403) | -3.02 (484) | -2.78 (243) | 1130 |
| cu-tectomt | 0.43 (363) | -3.24 (424) | -3.29 (213) | 1000 |
| TOTAL | 1,588 | 1,857 | 932 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| cu-bojar | 0.55 (490) | -2.98 (517) | -2.89 (261) | 1268 |
| uedin | 0.45 (499) | -3.08 (535) | -3.26 (270) | 1304 |
| pc-translator | 0.52 (479) | -2.87 (538) | -2.60 (271) | 1288 |
| cu-tectomt | 0.43 (483) | -3.07 (511) | -3.26 (265) | 1259 |
| TOTAL | 1,951 | 2,101 | 1,067 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| rbmt4 | 0.52 (137) | -3.03 (162) | -2.98 (71) | 370 |
| rbmt6 | 0.35 (164) | -3.37 (162) | -3.47 (84) | 410 |
| rbmt5 | 0.44 (160) | -3.45 (138) | -4.05 (71) | 369 |
| rbmt3 | 0.49 (153) | -3.35 (178) | -3.51 (85) | 416 |
| uedin | 0.74 (153) | -2.59 (166) | -2.55 (77) | 396 |
| saar | 0.70 (141) | -2.71 (149) | -2.43 (73) | 363 |
| ucl | 0.57 (164) | -3.05 (167) | -3.45 (79) | 410 |
| lium-systran | 0.85 (103) | -2.64 (114) | -2.46 (57) | 274 |
| saar-contrast | 0.0 (0) | 0.0 (0) | -2.29 (70) | 70 |
| limsi | 0.72 (114) | -2.59 (110) | -2.27 (47) | 271 |
| TOTAL | 1,289 | 1,346 | 714 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| rbmt6 | 0.55 (184) | -3.01 (206) | -2.83 (118) | 508 |
| rbmt5 | 0.64 (215) | -2.88 (206) | -2.51 (99) | 520 |
| lium-systran | 0.74 (150) | -2.78 (154) | -2.77 (83) | 387 |
| saar-contrast | 0.57 (160) | -2.87 (198) | -3.08 (92) | 450 |
| rbmt3 | 0.59 (180) | -2.89 (209) | -2.93 (110) | 499 |
| rbmt4 | 0.57 (199) | -2.72 (214) | -2.42 (106) | 519 |
| saar | 0.58 (166) | -3.00 (183) | -3.44 (85) | 434 |
| uedin | 0.62 (192) | -3.10 (226) | -3.20 (108) | 526 |
| limsi | 0.74 (127) | -2.92 (136) | -2.91 (71) | 334 |
| xerox | 0.31 (185) | -3.77 (198) | -4.02 (96) | 479 |
| TOTAL | 1,758 | 1,930 | 968 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| ucl | 0.61 (196) | -2.95 (199) | -3.59 (103) | 498 |
| rbmt3 | 0.56 (181) | -3.19 (198) | -2.82 (96) | 475 |
| rbmt5 | 0.46 (169) | -3.42 (203) | -3.30 (117) | 489 |
| limsi | 0.80 (181) | -2.74 (225) | -2.95 (93) | 499 |
| rbmt2 | 0.69 (196) | -3.20 (201) | -2.75 (95) | 492 |
| rbmt4 | 0.65 (163) | -3.17 (204) | -2.50 (108) | 475 |
| cmu-gimpel | 0.83 (214) | -2.68 (215) | -2.85 (100) | 529 |
| rbmt6 | 0.47 (166) | -3.48 (213) | -3.52 (102) | 481 |
| liu | 0.79 (188) | -2.61 (196) | -2.98 (93) | 477 |
| uedin | 0.83 (199) | -2.70 (190) | -2.62 (109) | 498 |
| saar | 0.76 (101) | -2.69 (93) | -3.24 (38) | 232 |
| TOTAL | 1,954 | 2,137 | 1,054 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| liu | 0.49 (266) | -3.19 (297) | -3.57 (138) | 701 |
| rbmt6 | 0.60 (268) | -3.14 (293) | -3.09 (163) | 724 |
| rbmt5 | 0.55 (242) | -3.06 (289) | -2.59 (151) | 682 |
| limsi | 0.56 (265) | -3.01 (272) | -3.76 (146) | 683 |
| rbmt3 | 0.66 (267) | -2.82 (300) | -2.68 (144) | 711 |
| uedin | 0.53 (246) | -3.29 (273) | -3.46 (146) | 665 |
| rbmt2 | 0.68 (298) | -2.68 (293) | -2.23 (138) | 729 |
| rbmt4 | 0.75 (264) | -2.70 (278) | -2.29 (140) | 682 |
| saar | 0.54 (142) | -3.22 (149) | -3.54 (79) | 370 |
| TOTAL | 2,258 | 2,444 | 1,245 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| rbmt4 | 0.61 (122) | -3.24 (122) | -3.08 (62) | 306 |
| uedin | 0.88 (128) | -2.65 (127) | -2.78 (65) | 320 |
| cmu-smt | 0.80 (129) | -2.75 (120) | -2.89 (68) | 317 |
| rbmt6 | 0.61 (122) | -3.41 (150) | -3.48 (62) | 334 |
| limsi | 0.85 (130) | -2.60 (133) | -2.61 (71) | 334 |
| rbmt3 | 0.60 (125) | -3.29 (123) | -3.19 (61) | 309 |
| rbmt5 | 0.62 (117) | -3.51 (131) | -3.48 (71) | 319 |
| ucl | 0.72 (125) | -3.29 (132) | -3.34 (64) | 321 |
| upc | 0.91 (66) | -2.77 (100) | -2.98 (45) | 211 |
| saar | 0.81 (145) | -2.57 (124) | -2.52 (69) | 338 |
| uw | 0.80 (95) | -2.72 (96) | -2.67 (56) | 247 |
| TOTAL | 1,304 | 1,358 | 694 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| rbmt4 | 0.75 (154) | -2.70 (169) | -2.74 (90) | 413 |
| rbmt5 | 0.62 (171) | -3.25 (156) | -2.60 (93) | 420 |
| rbmt3 | 0.65 (164) | -2.86 (160) | -2.83 (75) | 399 |
| cmu-smt | 0.47 (163) | -2.92 (169) | -3.35 (85) | 417 |
| uedin | 0.49 (159) | -3.24 (176) | -3.40 (83) | 418 |
| saar | 0.62 (165) | -2.88 (159) | -3.14 (79) | 403 |
| limsi | 0.52 (143) | -2.92 (163) | -3.26 (66) | 372 |
| rbmt6 | 0.62 (137) | -3.00 (155) | -2.55 (76) | 368 |
| ucb | 0.57 (136) | -3.12 (130) | -3.15 (65) | 331 |
| upc | 0.36 (83) | -3.24 (79) | -3.14 (43) | 205 |
| TOTAL | 1,475 | 1,516 | 755 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| saar-contrast | 0.87 (140) | -2.78 (172) | -2.36 (88) | 400 |
| cmu-statxfer | 0.61 (144) | -3.27 (143) | -3.45 (66) | 353 |
| rbmt6 | 0.53 (129) | -3.57 (144) | -3.89 (83) | 356 |
| cued | 0.83 (133) | -2.69 (132) | -2.69 (71) | 336 |
| rbmt5 | 0.70 (152) | -3.05 (142) | -3.34 (72) | 366 |
| dcu | 0.87 (139) | -2.75 (155) | -2.74 (78) | 372 |
| rbmt3 | 0.54 (157) | -3.51 (135) | -3.67 (73) | 365 |
| uedin | 0.90 (127) | -2.74 (134) | -2.44 (68) | 329 |
| rbmt4 | 0.62 (131) | -3.21 (144) | -3.17 (64) | 339 |
| systran | 0.79 (145) | -3.08 (131) | -3.34 (73) | 349 |
| saar | 0.71 (154) | -2.97 (128) | -3.06 (74) | 356 |
| lium-systran | 0.90 (143) | -2.67 (134) | -2.36 (68) | 345 |
| limsi | 0.88 (128) | -2.71 (167) | -2.37 (76) | 371 |
| ucl | 0.71 (140) | -3.09 (140) | -3.20 (59) | 339 |
| TOTAL | 1,962 | 2,001 | 1,013 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| bbn-combo | 0.0 (0) | 0.0 (0) | -2.86 (89) | 89 |
| saar-contrast | 0.66 (198) | -2.93 (237) | -2.83 (107) | 542 |
| lium-systran | 0.76 (192) | -2.84 (209) | -2.87 (94) | 495 |
| cmu-statxfer | 0.54 (236) | -3.44 (240) | -3.65 (94) | 570 |
| rbmt6 | 0.65 (203) | -3.18 (242) | -3.00 (93) | 538 |
| cued | 0.73 (216) | -2.98 (207) | -3.25 (97) | 520 |
| lium-systran-contrast | 0.69 (234) | -2.71 (211) | -2.79 (98) | 543 |
| rbmt5 | 0.74 (227) | -3.03 (224) | -2.81 (114) | 565 |
| rbmt3 | 0.64 (237) | -3.10 (229) | -3.08 (92) | 558 |
| limsi | 0.78 (229) | -2.83 (229) | -2.97 (95) | 553 |
| uedin | 0.69 (211) | -2.82 (246) | -2.76 (95) | 552 |
| cued-contrast | 0.79 (200) | -2.78 (222) | -2.77 (92) | 514 |
| rbmt4 | 0.62 (227) | -3.11 (226) | -3.10 (95) | 548 |
| saar | 0.65 (220) | -3.18 (252) | -3.17 (120) | 592 |
| cmu-combo | 0.0 (0) | 0.0 (0) | -3.07 (114) | 114 |
| uedin-combo | 0.0 (0) | 0.0 (0) | -3.02 (70) | 70 |
| TOTAL | 2,830 | 2,974 | 1,559 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| saar | 0.82 (125) | -2.54 (137) | -2.58 (76) | 338 |
| ucl | 0.50 (131) | -3.14 (177) | -3.48 (79) | 387 |
| rbmt6 | 0.63 (135) | -3.28 (179) | -3.11 (75) | 389 |
| cmu-statxfer | 0.53 (163) | -3.36 (168) | -3.71 (81) | 412 |
| rbmt5 | 0.63 (140) | -3.33 (169) | -3.01 (81) | 390 |
| limsi | 0.80 (152) | -2.78 (163) | -3.32 (66) | 381 |
| liu | 0.83 (119) | -2.65 (139) | -2.80 (64) | 322 |
| uedin | 0.86 (154) | -2.55 (147) | -2.52 (87) | 388 |
| rbmt3 | 0.75 (134) | -3.00 (157) | -2.87 (84) | 375 |
| rbmt4 | 0.67 (144) | -3.03 (155) | -2.80 (69) | 368 |
| rbmt2 | 0.76 (163) | -3.13 (159) | -2.78 (72) | 394 |
| TOTAL | 1,560 | 1,750 | 834 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| limsi | 0.73 (189) | -2.97 (201) | -3.41 (87) | 477 |
| rbmt2 | 0.70 (183) | -2.84 (212) | -2.29 (80) | 475 |
| rbmt3 | 0.73 (184) | -2.90 (191) | -2.46 (82) | 457 |
| rbmt5 | 0.59 (188) | -3.12 (204) | -2.62 (99) | 491 |
| saar-contrast | 0.70 (156) | -2.83 (170) | -2.65 (67) | 393 |
| rbmt4 | 0.72 (184) | -2.81 (193) | -2.37 (80) | 457 |
| saar | 0.66 (150) | -2.93 (135) | -2.93 (67) | 352 |
| rbmt6 | 0.67 (170) | -3.10 (182) | -2.86 (80) | 432 |
| uedin | 0.61 (187) | -2.89 (213) | -3.24 (93) | 493 |
| liu | 0.64 (148) | -3.09 (191) | -3.25 (85) | 424 |
| cmu-statxfer | 0.46 (176) | -3.48 (206) | -3.88 (100) | 482 |
| bbn-combo | 0.0 (0) | 0.0 (0) | -3.29 (75) | 75 |
| uedin-combo | 0.0 (0) | 0.0 (0) | -3.59 (67) | 67 |
| TOTAL | 1,915 | 2,098 | 1,062 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| uedin | 0.0 (0) | 0.0 (0) | -3.32 (542) | 542 |
| morphologic | 0.0 (0) | 0.0 (0) | -2.68 (543) | 543 |
| TOTAL | 0 | 0 | 1,085 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| ucl | 0.74 (171) | -3.16 (138) | -3.53 (70) | 379 |
| rbmt3 | 0.65 (126) | -3.61 (166) | -3.52 (93) | 385 |
| upc | 0.86 (129) | -2.59 (128) | -2.60 (70) | 327 |
| dcu | 0.86 (158) | -2.72 (139) | -2.71 (84) | 381 |
| cued | 0.86 (167) | -2.68 (157) | -2.70 (96) | 420 |
| rbmt4 | 0.57 (154) | -3.35 (150) | -3.26 (82) | 386 |
| limsi | 0.90 (170) | -2.70 (170) | -2.52 (77) | 417 |
| rbmt5 | 0.59 (152) | -3.68 (145) | -3.83 (67) | 364 |
| saar | 0.87 (154) | -2.63 (169) | -2.83 (97) | 420 |
| uedin | 0.87 (166) | -2.70 (158) | -2.77 (90) | 414 |
| rbmt6 | 0.56 (178) | -3.45 (172) | -3.29 (82) | 432 |
| cmu-smt | 0.88 (173) | -2.71 (163) | -2.65 (85) | 421 |
| TOTAL | 1,898 | 1,855 | 993 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED | TOTAL |
|---|---|---|---|---|
| saar | 0.70 (179) | -2.88 (184) | -2.82 (85) | 448 |
| rbmt5 | 0.60 (167) | -3.01 (175) | -3.15 (87) | 429 |
| rbmt3 | 0.61 (155) | -3.18 (197) | -2.86 (86) | 438 |
| rbmt6 | 0.64 (172) | -2.98 (180) | -3.01 (84) | 436 |
| cued-contrast | 0.71 (155) | -2.83 (161) | -2.87 (79) | 395 |
| ucb | 0.63 (167) | -2.99 (194) | -3.27 (94) | 455 |
| upc | 0.68 (142) | -2.94 (153) | -3.05 (83) | 378 |
| rbmt4 | 0.63 (159) | -3.30 (181) | -2.46 (105) | 445 |
| limsi | 0.69 (162) | -2.94 (206) | -3.03 (99) | 467 |
| cmu-smt | 0.63 (160) | -3.04 (178) | -3.19 (84) | 422 |
| uedin | 0.63 (172) | -2.89 (211) | -3.24 (91) | 474 |
| cued | 0.63 (141) | -2.99 (192) | -3.13 (78) | 411 |
| TOTAL | 1,931 | 2,212 | 1,055 |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| bbn-combo_fr | 4x: 1 items 3x: 6 items 2x: 6 items 1x: 65 items | ||
| saar-contrast_de | 4x: 2 items 3x: 1 items 2x: 13 items 1x: 77 items | ||
| rbmt3_fr | 3x: 2 items 2x: 11 items 1x: 84 items | ||
| saar_es | 5x: 1 items 3x: 4 items 2x: 11 items 1x: 85 items | ||
| limsi_es | 3x: 2 items 2x: 10 items 1x: 69 items | ||
| cued_es | 6x: 1 items 3x: 1 items 2x: 12 items 1x: 70 items | ||
| limsi_fr | 5x: 1 items 4x: 2 items 3x: 1 items 2x: 8 items 1x: 76 items | ||
| rbmt2_de | 4x: 1 items 3x: 3 items 2x: 12 items 1x: 79 items | ||
| rbmt3_de | 5x: 1 items 4x: 1 items 3x: 2 items 2x: 9 items 1x: 74 items | ||
| saar-contrast_fr | 3x: 4 items 2x: 9 items 1x: 72 items | ||
| rbmt5_fr | 4x: 1 items 3x: 5 items 2x: 12 items 1x: 68 items | ||
| ucb_es | 4x: 1 items 3x: 2 items 2x: 9 items 1x: 69 items | ||
| cmu-combo_fr | 3x: 3 items 2x: 13 items 1x: 70 items | ||
| rbmt6_fr | 4x: 1 items 3x: 6 items 2x: 8 items 1x: 65 items | ||
| saar_fr | 4x: 3 items 3x: 1 items 2x: 12 items 1x: 82 items | ||
| rbmt4_es | 3x: 3 items 2x: 14 items 1x: 71 items | ||
| rbmt6_es | 6x: 1 items 4x: 1 items 3x: 2 items 2x: 10 items 1x: 63 items | ||
| cued_fr | 5x: 1 items 4x: 1 items 3x: 1 items 2x: 11 items 1x: 75 items | ||
| lium-systran-contrast_fr | 4x: 3 items 3x: 5 items 2x: 6 items 1x: 82 items | ||
| liu_de | 3x: 7 items 2x: 5 items 1x: 59 items | ||
| rbmt4_de | 4x: 1 items 3x: 8 items 2x: 4 items 1x: 63 items | ||
| uedin_fr | 4x: 2 items 3x: 2 items 2x: 12 items 1x: 69 items | ||
| bbn-combo_de | 4x: 1 items 3x: 2 items 2x: 8 items 1x: 63 items | ||
| upc_es | 4x: 2 items 2x: 11 items 1x: 73 items | ||
| dcu_cz | 4x: 1 items 3x: 6 items 2x: 12 items 1x: 63 items | ||
| uedin_es | 4x: 1 items 3x: 2 items 2x: 10 items 1x: 75 items | ||
| rbmt3_es | 3x: 2 items 2x: 13 items 1x: 78 items | ||
| uedin_de | 4x: 1 items 3x: 1 items 2x: 12 items 1x: 67 items | ||
| cmu-statxfer_fr | 4x: 2 items 3x: 1 items 2x: 11 items 1x: 52 items | ||
| rbmt5_de | 3x: 7 items 2x: 11 items 1x: 57 items | ||
| umd_cz | 4x: 1 items 3x: 2 items 2x: 13 items 1x: 63 items | ||
| rbmt4_fr | 4x: 1 items 3x: 4 items 2x: 11 items 1x: 66 items | ||
| rbmt6_de | 4x: 2 items 3x: 4 items 2x: 10 items 1x: 73 items | ||
| cued-contrast_es | 5x: 1 items 3x: 5 items 2x: 11 items 1x: 67 items | ||
| uedin_cz | 3x: 4 items 2x: 6 items 1x: 81 items | ||
| lium-systran_fr | 4x: 1 items 3x: 3 items 2x: 16 items 1x: 72 items | ||
| limsi_de | 5x: 1 items 3x: 4 items 2x: 8 items 1x: 65 items | ||
| cued-contrast_fr | 4x: 2 items 3x: 2 items 2x: 10 items 1x: 79 items | ||
| rbmt5_es | 4x: 1 items 3x: 5 items 2x: 10 items 1x: 74 items | ||
| cmu-statxfer_de | 4x: 2 items 3x: 1 items 2x: 11 items 1x: 79 items | ||
| saar_de | 4x: 4 items 3x: 4 items 2x: 9 items 1x: 81 items | ||
| cmu-smt_es | 3x: 4 items 2x: 10 items 1x: 73 items | ||
| uedin_hu | 4x: 1 items 2x: 4 items 1x: 58 items | ||
| morphologic_hu | 3x: 3 items 2x: 3 items 1x: 45 items | ||
| uedin-combo_fr | 2x: 3 items 1x: 39 items | ||
| uedin-combo_xx | 3x: 1 items 2x: 3 items 1x: 43 items | ||
| uedin-combo_de | 3x: 1 items 2x: 6 items 1x: 39 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| dcu | 7x: 6 items 6x: 9 items 5x: 12 items 4x: 9 items 3x: 1 items 2x: 13 items 1x: 190 items | ||
| systran | 7x: 7 items 6x: 8 items 5x: 12 items 4x: 9 items 3x: 1 items 2x: 13 items 1x: 191 items | ||
| umd | 7x: 7 items 6x: 7 items 5x: 13 items 4x: 9 items 3x: 1 items 2x: 13 items 1x: 191 items | ||
| uedin | 7x: 7 items 6x: 8 items 5x: 11 items 4x: 10 items 3x: 1 items 2x: 13 items 1x: 190 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| umd | 10x: 1 items 9x: 1 items 8x: 3 items 7x: 9 items 6x: 6 items 5x: 6 items 4x: 4 items 3x: 8 items 2x: 13 items 1x: 221 items | ||
| uedin | 10x: 1 items 9x: 1 items 8x: 3 items 7x: 9 items 6x: 6 items 5x: 6 items 4x: 4 items 3x: 8 items 2x: 13 items 1x: 220 items | ||
| dcu | 10x: 1 items 9x: 1 items 8x: 3 items 7x: 9 items 6x: 6 items 5x: 6 items 4x: 4 items 3x: 8 items 2x: 13 items 1x: 220 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| uedin | 8x: 2 items 7x: 1 items 6x: 10 items 5x: 7 items 4x: 6 items 3x: 6 items 2x: 7 items 1x: 206 items | 10x: 1 items 9x: 1 items 8x: 1 items 7x: 4 items 6x: 5 items 5x: 12 items 4x: 10 items 3x: 6 items 2x: 3 items 1x: 234 items | 5x: 2 items 4x: 6 items 3x: 8 items 2x: 18 items 1x: 121 items |
| cu-bojar | 7x: 5 items 6x: 9 items 5x: 4 items 4x: 9 items 3x: 6 items 2x: 3 items 1x: 208 items | 10x: 1 items 8x: 1 items 7x: 3 items 6x: 5 items 5x: 14 items 4x: 9 items 3x: 6 items 2x: 4 items 1x: 222 items | 5x: 2 items 4x: 3 items 3x: 10 items 2x: 19 items 1x: 116 items |
| pc-translator | 7x: 5 items 6x: 7 items 5x: 9 items 4x: 4 items 3x: 7 items 2x: 8 items 1x: 198 items | 10x: 1 items 9x: 1 items 8x: 1 items 7x: 4 items 6x: 5 items 5x: 13 items 4x: 9 items 3x: 6 items 2x: 3 items 1x: 232 items | 5x: 2 items 4x: 6 items 3x: 8 items 2x: 18 items 1x: 121 items |
| cu-tectomt | 6x: 6 items 5x: 10 items 4x: 9 items 3x: 6 items 2x: 6 items 1x: 182 items | 10x: 1 items 8x: 1 items 7x: 2 items 6x: 2 items 5x: 10 items 4x: 15 items 3x: 6 items 2x: 5 items 1x: 206 items | 5x: 1 items 4x: 2 items 3x: 10 items 2x: 18 items 1x: 111 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| cu-bojar | 11x: 1 items 8x: 7 items 7x: 4 items 6x: 3 items 5x: 13 items 4x: 5 items 3x: 2 items 2x: 12 items 1x: 221 items | 12x: 1 items 9x: 1 items 8x: 7 items 7x: 5 items 6x: 5 items 5x: 9 items 4x: 4 items 3x: 4 items 2x: 10 items 1x: 240 items | 6x: 1 items 5x: 6 items 4x: 5 items 3x: 5 items 2x: 15 items 1x: 128 items |
| uedin | 9x: 2 items 8x: 3 items 7x: 9 items 6x: 5 items 5x: 8 items 4x: 8 items 3x: 2 items 2x: 10 items 1x: 224 items | 13x: 1 items 10x: 2 items 9x: 2 items 8x: 4 items 7x: 6 items 6x: 5 items 5x: 9 items 4x: 3 items 3x: 5 items 2x: 10 items 1x: 244 items | 6x: 1 items 5x: 6 items 4x: 5 items 3x: 7 items 2x: 13 items 1x: 134 items |
| pc-translator | 10x: 1 items 9x: 2 items 8x: 3 items 7x: 2 items 6x: 7 items 5x: 13 items 4x: 3 items 3x: 7 items 2x: 7 items 1x: 220 items | 13x: 1 items 9x: 3 items 8x: 5 items 7x: 7 items 6x: 4 items 5x: 9 items 4x: 4 items 3x: 4 items 2x: 10 items 1x: 249 items | 6x: 1 items 5x: 6 items 4x: 6 items 3x: 6 items 2x: 14 items 1x: 131 items |
| cu-tectomt | 10x: 1 items 9x: 1 items 8x: 3 items 7x: 1 items 6x: 10 items 5x: 9 items 4x: 6 items 3x: 7 items 2x: 9 items 1x: 225 items | 14x: 1 items 8x: 5 items 7x: 8 items 6x: 5 items 5x: 9 items 4x: 4 items 3x: 5 items 2x: 10 items 1x: 233 items | 6x: 1 items 5x: 5 items 4x: 5 items 3x: 9 items 2x: 12 items 1x: 131 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| rbmt4 | 5x: 1 items 4x: 2 items 3x: 4 items 2x: 16 items 1x: 70 items | 4x: 2 items 3x: 5 items 2x: 12 items 1x: 96 items | 2x: 7 items 1x: 53 items |
| rbmt6 | 5x: 1 items 4x: 2 items 3x: 8 items 2x: 13 items 1x: 86 items | 3x: 7 items 2x: 15 items 1x: 92 items | 3x: 1 items 2x: 7 items 1x: 57 items |
| rbmt5 | 4x: 1 items 3x: 7 items 2x: 14 items 1x: 92 items | 4x: 1 items 3x: 4 items 2x: 13 items 1x: 85 items | 3x: 2 items 2x: 6 items 1x: 46 items |
| rbmt3 | 4x: 1 items 3x: 9 items 2x: 12 items 1x: 84 items | 5x: 2 items 4x: 2 items 3x: 4 items 2x: 17 items 1x: 94 items | 4x: 1 items 3x: 1 items 2x: 4 items 1x: 62 items |
| uedin | 5x: 2 items 4x: 2 items 3x: 6 items 2x: 10 items 1x: 85 items | 5x: 1 items 4x: 2 items 3x: 5 items 2x: 15 items 1x: 97 items | 3x: 1 items 2x: 6 items 1x: 52 items |
| saar | 6x: 1 items 3x: 5 items 2x: 9 items 1x: 86 items | 4x: 1 items 3x: 5 items 2x: 11 items 1x: 94 items | 3x: 1 items 2x: 5 items 1x: 49 items |
| ucl | 5x: 2 items 4x: 1 items 3x: 8 items 2x: 10 items 1x: 91 items | 5x: 1 items 3x: 7 items 2x: 15 items 1x: 93 items | 3x: 2 items 2x: 4 items 1x: 57 items |
| lium-systran | 4x: 1 items 3x: 3 items 2x: 7 items 1x: 62 items | 5x: 1 items 3x: 2 items 2x: 10 items 1x: 73 items | 4x: 1 items 3x: 1 items 2x: 3 items 1x: 37 items |
| saar-contrast | 3x: 1 items 2x: 7 items 1x: 46 items | ||
| limsi | 4x: 1 items 3x: 4 items 2x: 6 items 1x: 71 items | 2x: 14 items 1x: 68 items | 2x: 3 items 1x: 35 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| rbmt6 | 5x: 1 items 4x: 3 items 3x: 10 items 2x: 6 items 1x: 110 items | 5x: 3 items 4x: 5 items 3x: 9 items 2x: 13 items 1x: 103 items | 5x: 1 items 4x: 1 items 3x: 4 items 2x: 9 items 1x: 66 items |
| rbmt5 | 5x: 2 items 4x: 4 items 3x: 9 items 2x: 13 items 1x: 116 items | 5x: 2 items 4x: 7 items 3x: 9 items 2x: 11 items 1x: 110 items | 4x: 1 items 3x: 1 items 2x: 4 items 1x: 69 items |
| lium-systran | 4x: 2 items 3x: 4 items 2x: 11 items 1x: 92 items | 3x: 5 items 2x: 16 items 1x: 93 items | 3x: 1 items 2x: 6 items 1x: 60 items |
| saar-contrast | 4x: 5 items 3x: 5 items 2x: 14 items 1x: 84 items | 6x: 2 items 5x: 3 items 4x: 1 items 3x: 9 items 2x: 12 items 1x: 100 items | 5x: 1 items 4x: 1 items 3x: 1 items 2x: 9 items 1x: 51 items |
| rbmt3 | 4x: 4 items 3x: 4 items 2x: 16 items 1x: 107 items | 7x: 1 items 4x: 7 items 3x: 9 items 2x: 12 items 1x: 111 items | 4x: 2 items 3x: 3 items 2x: 10 items 1x: 61 items |
| rbmt4 | 5x: 1 items 4x: 5 items 3x: 9 items 2x: 8 items 1x: 115 items | 5x: 1 items 4x: 3 items 3x: 13 items 2x: 7 items 1x: 125 items | 4x: 1 items 3x: 1 items 2x: 13 items 1x: 63 items |
| saar | 4x: 7 items 3x: 4 items 2x: 17 items 1x: 87 items | 5x: 1 items 4x: 4 items 3x: 9 items 2x: 11 items 1x: 100 items | 3x: 3 items 2x: 6 items 1x: 55 items |
| uedin | 6x: 1 items 4x: 2 items 3x: 12 items 2x: 9 items 1x: 109 items | 8x: 1 items 5x: 1 items 4x: 9 items 3x: 7 items 2x: 13 items 1x: 114 items | 3x: 5 items 2x: 8 items 1x: 67 items |
| limsi | 4x: 3 items 3x: 5 items 2x: 5 items 1x: 78 items | 4x: 1 items 3x: 5 items 2x: 13 items 1x: 81 items | 3x: 1 items 2x: 6 items 1x: 49 items |
| xerox | 5x: 1 items 4x: 1 items 3x: 9 items 2x: 19 items 1x: 100 items | 5x: 2 items 4x: 7 items 3x: 9 items 2x: 8 items 1x: 101 items | 4x: 1 items 3x: 2 items 2x: 10 items 1x: 58 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| ucl | 4x: 4 items 3x: 6 items 2x: 15 items 1x: 109 items | 5x: 1 items 4x: 5 items 3x: 7 items 2x: 13 items 1x: 104 items | 4x: 1 items 3x: 3 items 2x: 6 items 1x: 67 items |
| rbmt3 | 5x: 1 items 4x: 2 items 3x: 5 items 2x: 16 items 1x: 97 items | 4x: 7 items 3x: 8 items 2x: 9 items 1x: 105 items | 3x: 2 items 2x: 7 items 1x: 64 items |
| rbmt5 | 4x: 3 items 3x: 3 items 2x: 13 items 1x: 104 items | 6x: 1 items 5x: 2 items 4x: 4 items 3x: 8 items 2x: 10 items 1x: 106 items | 5x: 1 items 3x: 1 items 2x: 11 items 1x: 70 items |
| limsi | 5x: 1 items 4x: 4 items 3x: 6 items 2x: 15 items 1x: 90 items | 6x: 2 items 5x: 1 items 4x: 6 items 3x: 8 items 2x: 10 items 1x: 111 items | 3x: 1 items 2x: 10 items 1x: 60 items |
| rbmt2 | 5x: 1 items 4x: 3 items 3x: 9 items 2x: 13 items 1x: 101 items | 5x: 4 items 4x: 2 items 3x: 4 items 2x: 17 items 1x: 104 items | 4x: 1 items 3x: 1 items 2x: 9 items 1x: 60 items |
| rbmt4 | 4x: 2 items 3x: 9 items 2x: 5 items 1x: 98 items | 6x: 1 items 5x: 1 items 4x: 1 items 3x: 8 items 2x: 11 items 1x: 126 items | 4x: 1 items 3x: 2 items 2x: 7 items 1x: 73 items |
| cmu-gimpel | 6x: 1 items 5x: 1 items 4x: 6 items 3x: 9 items 2x: 6 items 1x: 114 items | 5x: 1 items 4x: 6 items 3x: 8 items 2x: 10 items 1x: 120 items | 3x: 2 items 2x: 9 items 1x: 68 items |
| rbmt6 | 5x: 1 items 4x: 5 items 3x: 2 items 2x: 8 items 1x: 105 items | 5x: 1 items 4x: 3 items 3x: 10 items 2x: 11 items 1x: 110 items | 3x: 4 items 2x: 7 items 1x: 63 items |
| liu | 5x: 1 items 4x: 5 items 3x: 3 items 2x: 18 items 1x: 107 items | 5x: 1 items 4x: 2 items 3x: 16 items 2x: 9 items 1x: 97 items | 4x: 2 items 3x: 2 items 2x: 4 items 1x: 62 items |
| uedin | 6x: 1 items 5x: 1 items 3x: 5 items 2x: 16 items 1x: 112 items | 5x: 2 items 4x: 4 items 3x: 10 items 2x: 8 items 1x: 96 items | 3x: 3 items 2x: 6 items 1x: 75 items |
| saar | 4x: 1 items 3x: 4 items 2x: 7 items 1x: 59 items | 3x: 1 items 2x: 11 items 1x: 59 items | 3x: 1 items 2x: 1 items 1x: 28 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| liu | 10x: 1 items 6x: 1 items 5x: 2 items 4x: 4 items 3x: 10 items 2x: 19 items 1x: 129 items | 7x: 2 items 6x: 4 items 5x: 3 items 4x: 7 items 3x: 6 items 2x: 12 items 1x: 150 items | 5x: 1 items 3x: 6 items 2x: 13 items 1x: 74 items |
| rbmt6 | 7x: 1 items 6x: 1 items 5x: 2 items 4x: 4 items 3x: 13 items 2x: 16 items 1x: 124 items | 7x: 1 items 6x: 1 items 5x: 4 items 4x: 6 items 3x: 11 items 2x: 14 items 1x: 148 items | 4x: 1 items 3x: 7 items 2x: 10 items 1x: 98 items |
| rbmt5 | 8x: 1 items 6x: 2 items 5x: 1 items 4x: 4 items 3x: 14 items 2x: 10 items 1x: 111 items | 8x: 1 items 6x: 1 items 5x: 8 items 4x: 7 items 3x: 9 items 2x: 14 items 1x: 125 items | 4x: 2 items 3x: 7 items 2x: 7 items 1x: 87 items |
| limsi | 6x: 1 items 5x: 5 items 4x: 5 items 3x: 14 items 2x: 10 items 1x: 134 items | 6x: 2 items 5x: 2 items 4x: 7 items 3x: 10 items 2x: 12 items 1x: 136 items | 3x: 5 items 2x: 15 items 1x: 80 items |
| rbmt3 | 5x: 8 items 4x: 3 items 3x: 13 items 2x: 15 items 1x: 120 items | 6x: 5 items 5x: 5 items 4x: 6 items 3x: 13 items 2x: 5 items 1x: 145 items | 4x: 1 items 3x: 2 items 2x: 13 items 1x: 92 items |
| uedin | 8x: 1 items 5x: 1 items 4x: 5 items 3x: 13 items 2x: 13 items 1x: 122 items | 6x: 3 items 5x: 1 items 4x: 10 items 3x: 9 items 2x: 15 items 1x: 130 items | 4x: 2 items 3x: 7 items 2x: 12 items 1x: 78 items |
| rbmt2 | 6x: 1 items 5x: 8 items 4x: 4 items 3x: 8 items 2x: 20 items 1x: 142 items | 6x: 1 items 5x: 7 items 4x: 5 items 3x: 12 items 2x: 9 items 1x: 153 items | 3x: 6 items 2x: 7 items 1x: 89 items |
| rbmt4 | 7x: 1 items 6x: 1 items 4x: 11 items 3x: 7 items 2x: 12 items 1x: 131 items | 6x: 1 items 5x: 5 items 4x: 7 items 3x: 11 items 2x: 12 items 1x: 137 items | 4x: 4 items 3x: 2 items 2x: 12 items 1x: 79 items |
| saar | 4x: 1 items 3x: 4 items 2x: 14 items 1x: 87 items | 5x: 1 items 4x: 2 items 3x: 7 items 2x: 12 items 1x: 82 items | 3x: 3 items 2x: 5 items 1x: 50 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| rbmt4 | 3x: 3 items 2x: 16 items 1x: 67 items | 3x: 4 items 2x: 8 items 1x: 80 items | 3x: 1 items 2x: 2 items 1x: 47 items |
| uedin | 3x: 3 items 2x: 15 items 1x: 75 items | 5x: 1 items 3x: 5 items 2x: 12 items 1x: 69 items | 4x: 1 items 2x: 5 items 1x: 41 items |
| cmu-smt | 3x: 8 items 2x: 6 items 1x: 79 items | 4x: 1 items 3x: 2 items 2x: 8 items 1x: 83 items | 2x: 6 items 1x: 49 items |
| rbmt6 | 4x: 1 items 3x: 4 items 2x: 9 items 1x: 74 items | 5x: 1 items 3x: 3 items 2x: 13 items 1x: 91 items | 3x: 1 items 2x: 5 items 1x: 43 items |
| limsi | 4x: 2 items 3x: 6 items 2x: 8 items 1x: 74 items | 5x: 1 items 3x: 2 items 2x: 13 items 1x: 79 items | 3x: 3 items 2x: 2 items 1x: 50 items |
| rbmt3 | 4x: 1 items 3x: 6 items 2x: 8 items 1x: 77 items | 3x: 3 items 2x: 13 items 1x: 74 items | 2x: 5 items 1x: 45 items |
| rbmt5 | 5x: 1 items 3x: 6 items 2x: 5 items 1x: 72 items | 3x: 3 items 2x: 14 items 1x: 76 items | 3x: 1 items 2x: 5 items 1x: 46 items |
| ucl | 3x: 5 items 2x: 9 items 1x: 74 items | 4x: 1 items 3x: 3 items 2x: 16 items 1x: 73 items | 3x: 1 items 2x: 3 items 1x: 48 items |
| upc | 3x: 2 items 2x: 8 items 1x: 38 items | 3x: 1 items 2x: 13 items 1x: 60 items | 3x: 1 items 1x: 38 items |
| saar | 5x: 1 items 4x: 2 items 3x: 4 items 2x: 9 items 1x: 88 items | 3x: 4 items 2x: 8 items 1x: 82 items | 2x: 2 items 1x: 56 items |
| uw | 3x: 2 items 2x: 8 items 1x: 64 items | 3x: 2 items 2x: 9 items 1x: 63 items | 3x: 1 items 1x: 45 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| rbmt4 | 4x: 2 items 3x: 6 items 2x: 10 items 1x: 92 items | 4x: 1 items 3x: 10 items 2x: 7 items 1x: 106 items | 4x: 1 items 3x: 1 items 2x: 9 items 1x: 56 items |
| rbmt5 | 4x: 3 items 3x: 6 items 2x: 12 items 1x: 99 items | 5x: 1 items 4x: 2 items 3x: 8 items 2x: 10 items 1x: 90 items | 3x: 1 items 2x: 9 items 1x: 60 items |
| rbmt3 | 4x: 1 items 3x: 6 items 2x: 18 items 1x: 85 items | 4x: 2 items 3x: 8 items 2x: 8 items 1x: 100 items | 3x: 1 items 2x: 7 items 1x: 48 items |
| cmu-smt | 5x: 1 items 4x: 3 items 3x: 9 items 2x: 11 items 1x: 84 items | 5x: 2 items 4x: 2 items 3x: 6 items 2x: 12 items 1x: 96 items | 3x: 3 items 2x: 6 items 1x: 53 items |
| uedin | 3x: 9 items 2x: 7 items 1x: 97 items | 5x: 1 items 4x: 5 items 3x: 3 items 2x: 14 items 1x: 95 items | 3x: 1 items 2x: 7 items 1x: 58 items |
| saar | 5x: 1 items 4x: 1 items 3x: 3 items 2x: 16 items 1x: 99 items | 5x: 1 items 4x: 2 items 3x: 6 items 2x: 14 items 1x: 84 items | 3x: 1 items 2x: 8 items 1x: 52 items |
| limsi | 4x: 2 items 3x: 4 items 2x: 10 items 1x: 85 items | 4x: 4 items 3x: 8 items 2x: 9 items 1x: 88 items | 2x: 7 items 1x: 42 items |
| rbmt6 | 3x: 6 items 2x: 10 items 1x: 81 items | 4x: 3 items 3x: 6 items 2x: 13 items 1x: 86 items | 3x: 2 items 2x: 5 items 1x: 47 items |
| ucb | 4x: 1 items 3x: 7 items 2x: 8 items 1x: 77 items | 4x: 1 items 3x: 6 items 2x: 13 items 1x: 69 items | 2x: 5 items 1x: 46 items |
| upc | 2x: 9 items 1x: 56 items | 3x: 2 items 2x: 7 items 1x: 51 items | 2x: 1 items 1x: 36 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| saar-contrast | 4x: 1 items 3x: 5 items 2x: 11 items 1x: 84 items | 5x: 1 items 4x: 5 items 3x: 6 items 2x: 10 items 1x: 98 items | 3x: 4 items 2x: 6 items 1x: 56 items |
| cmu-statxfer | 6x: 1 items 4x: 2 items 3x: 7 items 2x: 12 items 1x: 75 items | 5x: 1 items 4x: 2 items 3x: 2 items 2x: 18 items 1x: 79 items | 4x: 1 items 2x: 6 items 1x: 44 items |
| rbmt6 | 4x: 4 items 3x: 2 items 2x: 11 items 1x: 79 items | 5x: 1 items 4x: 3 items 3x: 3 items 2x: 18 items 1x: 74 items | 4x: 1 items 2x: 9 items 1x: 52 items |
| cued | 5x: 1 items 4x: 1 items 3x: 4 items 2x: 12 items 1x: 80 items | 5x: 1 items 4x: 2 items 3x: 4 items 2x: 12 items 1x: 74 items | 4x: 1 items 3x: 2 items 2x: 3 items 1x: 47 items |
| rbmt5 | 5x: 1 items 4x: 5 items 3x: 2 items 2x: 7 items 1x: 94 items | 5x: 1 items 4x: 3 items 3x: 5 items 2x: 9 items 1x: 81 items | 2x: 6 items 1x: 55 items |
| dcu | 4x: 1 items 3x: 2 items 2x: 18 items 1x: 80 items | 4x: 3 items 3x: 3 items 2x: 15 items 1x: 93 items | 3x: 3 items 2x: 5 items 1x: 49 items |
| rbmt3 | 6x: 1 items 5x: 1 items 4x: 2 items 3x: 8 items 2x: 9 items 1x: 84 items | 5x: 2 items 4x: 1 items 3x: 3 items 2x: 11 items 1x: 80 items | 3x: 1 items 2x: 5 items 1x: 54 items |
| uedin | 5x: 1 items 3x: 5 items 2x: 9 items 1x: 79 items | 3x: 6 items 2x: 11 items 1x: 85 items | 3x: 3 items 2x: 1 items 1x: 46 items |
| rbmt4 | 6x: 1 items 5x: 1 items 4x: 1 items 3x: 1 items 2x: 13 items 1x: 76 items | 4x: 4 items 3x: 3 items 2x: 12 items 1x: 87 items | 3x: 1 items 2x: 4 items 1x: 47 items |
| systran | 4x: 2 items 3x: 4 items 2x: 14 items 1x: 83 items | 4x: 2 items 3x: 3 items 2x: 14 items 1x: 82 items | 3x: 2 items 2x: 7 items 1x: 46 items |
| saar | 5x: 1 items 4x: 2 items 3x: 8 items 2x: 13 items 1x: 79 items | 4x: 3 items 3x: 7 items 2x: 8 items 1x: 72 items | 4x: 1 items 3x: 2 items 2x: 5 items 1x: 49 items |
| lium-systran | 6x: 1 items 3x: 4 items 2x: 16 items 1x: 79 items | 4x: 1 items 3x: 6 items 2x: 14 items 1x: 73 items | 2x: 2 items 1x: 56 items |
| limsi | 5x: 1 items 4x: 2 items 3x: 5 items 2x: 11 items 1x: 68 items | 5x: 1 items 4x: 3 items 3x: 4 items 2x: 14 items 1x: 102 items | 3x: 1 items 2x: 4 items 1x: 57 items |
| ucl | 3x: 5 items 2x: 12 items 1x: 90 items | 4x: 2 items 3x: 6 items 2x: 13 items 1x: 79 items | 3x: 1 items 2x: 3 items 1x: 47 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| bbn-combo | 4x: 1 items 3x: 1 items 2x: 11 items 1x: 51 items | ||
| saar-contrast | 6x: 1 items 5x: 1 items 4x: 4 items 3x: 6 items 2x: 14 items 1x: 109 items | 5x: 6 items 4x: 8 items 3x: 7 items 2x: 11 items 1x: 119 items | 4x: 2 items 3x: 1 items 2x: 7 items 1x: 64 items |
| lium-systran | 6x: 1 items 5x: 1 items 4x: 5 items 3x: 3 items 2x: 12 items 1x: 114 items | 5x: 1 items 4x: 4 items 3x: 12 items 2x: 14 items 1x: 109 items | 3x: 3 items 2x: 6 items 1x: 63 items |
| cmu-statxfer | 6x: 1 items 5x: 3 items 4x: 5 items 3x: 10 items 2x: 10 items 1x: 126 items | 5x: 4 items 4x: 6 items 3x: 10 items 2x: 12 items 1x: 121 items | 4x: 1 items 3x: 1 items 2x: 8 items 1x: 61 items |
| rbmt6 | 5x: 1 items 4x: 6 items 3x: 6 items 2x: 8 items 1x: 123 items | 6x: 1 items 5x: 2 items 4x: 5 items 3x: 12 items 2x: 11 items 1x: 134 items | 3x: 2 items 2x: 9 items 1x: 61 items |
| cued | 5x: 3 items 4x: 6 items 3x: 7 items 2x: 14 items 1x: 107 items | 6x: 1 items 5x: 1 items 4x: 4 items 3x: 13 items 2x: 9 items 1x: 107 items | 3x: 3 items 2x: 9 items 1x: 58 items |
| lium-systran-contrast | 6x: 2 items 5x: 3 items 4x: 4 items 3x: 9 items 2x: 10 items 1x: 122 items | 5x: 2 items 4x: 3 items 3x: 11 items 2x: 13 items 1x: 116 items | 4x: 1 items 3x: 3 items 2x: 8 items 1x: 52 items |
| rbmt5 | 8x: 1 items 7x: 1 items 5x: 2 items 4x: 5 items 3x: 5 items 2x: 12 items 1x: 124 items | 6x: 2 items 5x: 3 items 4x: 1 items 3x: 9 items 2x: 18 items 1x: 108 items | 3x: 2 items 2x: 13 items 1x: 62 items |
| rbmt3 | 6x: 2 items 5x: 5 items 4x: 4 items 3x: 6 items 2x: 15 items 1x: 115 items | 5x: 2 items 4x: 6 items 3x: 11 items 2x: 11 items 1x: 122 items | 4x: 2 items 3x: 1 items 2x: 3 items 1x: 67 items |
| limsi | 7x: 1 items 5x: 4 items 4x: 2 items 3x: 10 items 2x: 16 items 1x: 117 items | 6x: 2 items 5x: 2 items 4x: 1 items 3x: 11 items 2x: 13 items 1x: 121 items | 4x: 1 items 2x: 9 items 1x: 61 items |
| uedin | 5x: 1 items 4x: 3 items 3x: 7 items 2x: 14 items 1x: 122 items | 8x: 1 items 6x: 1 items 5x: 2 items 4x: 6 items 3x: 7 items 2x: 15 items 1x: 125 items | 4x: 2 items 2x: 4 items 1x: 69 items |
| cued-contrast | 5x: 1 items 4x: 6 items 3x: 7 items 2x: 14 items 1x: 108 items | 7x: 1 items 5x: 2 items 4x: 9 items 3x: 6 items 2x: 5 items 1x: 125 items | 3x: 1 items 2x: 11 items 1x: 57 items |
| rbmt4 | 4x: 6 items 3x: 10 items 2x: 11 items 1x: 127 items | 7x: 1 items 5x: 3 items 4x: 4 items 3x: 9 items 2x: 11 items 1x: 117 items | 3x: 1 items 2x: 8 items 1x: 62 items |
| saar | 5x: 4 items 4x: 2 items 3x: 10 items 2x: 16 items 1x: 110 items | 4x: 6 items 3x: 15 items 2x: 11 items 1x: 139 items | 4x: 1 items 3x: 4 items 2x: 11 items 1x: 70 items |
| cmu-combo | 3x: 3 items 2x: 14 items 1x: 63 items | ||
| uedin-combo | 2x: 7 items 1x: 50 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| saar | 4x: 1 items 3x: 6 items 2x: 11 items 1x: 73 items | 3x: 6 items 2x: 14 items 1x: 79 items | 3x: 3 items 2x: 7 items 1x: 42 items |
| ucl | 4x: 1 items 3x: 7 items 2x: 9 items 1x: 79 items | 7x: 1 items 5x: 1 items 4x: 4 items 3x: 5 items 2x: 12 items 1x: 94 items | 4x: 1 items 3x: 2 items 2x: 5 items 1x: 48 items |
| rbmt6 | 4x: 5 items 3x: 7 items 2x: 6 items 1x: 75 items | 5x: 1 items 4x: 6 items 3x: 8 items 2x: 11 items 1x: 87 items | 4x: 1 items 2x: 9 items 1x: 46 items |
| cmu-statxfer | 5x: 1 items 4x: 4 items 3x: 8 items 2x: 12 items 1x: 85 items | 5x: 1 items 4x: 2 items 3x: 12 items 2x: 13 items 1x: 80 items | 3x: 3 items 2x: 2 items 1x: 52 items |
| rbmt5 | 5x: 1 items 4x: 2 items 3x: 5 items 2x: 11 items 1x: 79 items | 6x: 1 items 5x: 1 items 4x: 4 items 3x: 5 items 2x: 18 items 1x: 80 items | 4x: 1 items 3x: 2 items 2x: 7 items 1x: 44 items |
| limsi | 5x: 1 items 4x: 2 items 3x: 5 items 2x: 14 items 1x: 86 items | 5x: 2 items 4x: 3 items 3x: 3 items 2x: 15 items 1x: 88 items | 3x: 3 items 2x: 5 items 1x: 40 items |
| liu | 4x: 1 items 3x: 3 items 2x: 12 items 1x: 74 items | 5x: 2 items 3x: 9 items 2x: 10 items 1x: 72 items | 3x: 2 items 2x: 3 items 1x: 40 items |
| uedin | 5x: 2 items 4x: 2 items 3x: 6 items 2x: 12 items 1x: 85 items | 5x: 1 items 4x: 1 items 3x: 8 items 2x: 14 items 1x: 76 items | 5x: 1 items 3x: 2 items 2x: 5 items 1x: 55 items |
| rbmt3 | 4x: 1 items 3x: 5 items 2x: 17 items 1x: 75 items | 6x: 1 items 4x: 2 items 3x: 4 items 2x: 12 items 1x: 97 items | 4x: 1 items 3x: 3 items 2x: 6 items 1x: 49 items |
| rbmt4 | 4x: 5 items 3x: 8 items 2x: 7 items 1x: 79 items | 5x: 1 items 4x: 1 items 3x: 8 items 2x: 11 items 1x: 87 items | 4x: 1 items 2x: 4 items 1x: 47 items |
| rbmt2 | 5x: 2 items 4x: 6 items 3x: 3 items 2x: 10 items 1x: 87 items | 5x: 1 items 4x: 6 items 3x: 2 items 2x: 12 items 1x: 86 items | 3x: 1 items 2x: 4 items 1x: 51 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| limsi | 6x: 1 items 5x: 1 items 4x: 5 items 3x: 9 items 2x: 11 items 1x: 90 items | 5x: 1 items 4x: 4 items 3x: 7 items 2x: 19 items 1x: 98 items | 3x: 2 items 2x: 5 items 1x: 56 items |
| rbmt2 | 5x: 1 items 4x: 4 items 3x: 8 items 2x: 13 items 1x: 95 items | 8x: 1 items 5x: 2 items 4x: 6 items 3x: 7 items 2x: 17 items 1x: 99 items | 3x: 2 items 2x: 6 items 1x: 57 items |
| rbmt3 | 4x: 5 items 3x: 5 items 2x: 13 items 1x: 105 items | 5x: 2 items 4x: 3 items 3x: 6 items 2x: 19 items 1x: 98 items | 3x: 2 items 2x: 5 items 1x: 59 items |
| rbmt5 | 5x: 1 items 3x: 8 items 2x: 18 items 1x: 106 items | 7x: 1 items 6x: 1 items 4x: 3 items 3x: 10 items 2x: 16 items 1x: 103 items | 4x: 1 items 3x: 1 items 2x: 9 items 1x: 61 items |
| saar-contrast | 4x: 1 items 3x: 7 items 2x: 15 items 1x: 88 items | 6x: 1 items 5x: 1 items 4x: 3 items 3x: 3 items 2x: 19 items 1x: 84 items | 3x: 2 items 2x: 4 items 1x: 47 items |
| rbmt4 | 5x: 1 items 4x: 1 items 3x: 6 items 2x: 20 items 1x: 98 items | 4x: 3 items 3x: 9 items 2x: 10 items 1x: 115 items | 3x: 2 items 2x: 3 items 1x: 58 items |
| saar | 4x: 2 items 3x: 4 items 2x: 12 items 1x: 95 items | 5x: 1 items 3x: 3 items 2x: 14 items 1x: 79 items | 3x: 1 items 2x: 4 items 1x: 48 items |
| rbmt6 | 5x: 1 items 4x: 2 items 3x: 7 items 2x: 11 items 1x: 96 items | 4x: 5 items 3x: 12 items 2x: 12 items 1x: 85 items | 3x: 3 items 2x: 8 items 1x: 47 items |
| uedin | 5x: 1 items 4x: 3 items 3x: 8 items 2x: 11 items 1x: 104 items | 6x: 1 items 5x: 2 items 4x: 2 items 3x: 10 items 2x: 15 items 1x: 105 items | 3x: 2 items 2x: 8 items 1x: 60 items |
| liu | 5x: 1 items 4x: 1 items 3x: 7 items 2x: 16 items 1x: 78 items | 6x: 1 items 4x: 5 items 3x: 10 items 2x: 18 items 1x: 87 items | 3x: 2 items 2x: 6 items 1x: 61 items |
| cmu-statxfer | 4x: 3 items 3x: 5 items 2x: 18 items 1x: 97 items | 6x: 1 items 5x: 3 items 4x: 3 items 3x: 4 items 2x: 18 items 1x: 106 items | 5x: 1 items 3x: 2 items 2x: 9 items 1x: 58 items |
| bbn-combo | 5x: 1 items 2x: 7 items 1x: 50 items | ||
| uedin-combo | 3x: 2 items 2x: 3 items 1x: 49 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| uedin | 7x: 9 items 6x: 12 items 5x: 9 items 4x: 7 items 3x: 3 items 2x: 16 items 1x: 233 items | ||
| morphologic | 7x: 9 items 6x: 12 items 5x: 9 items 4x: 7 items 3x: 3 items 2x: 16 items 1x: 234 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| ucl | 5x: 1 items 4x: 5 items 3x: 5 items 2x: 9 items 1x: 101 items | 8x: 1 items 4x: 1 items 3x: 7 items 2x: 9 items 1x: 78 items | 3x: 1 items 2x: 6 items 1x: 49 items |
| rbmt3 | 5x: 1 items 4x: 2 items 3x: 3 items 2x: 9 items 1x: 76 items | 6x: 2 items 5x: 2 items 4x: 3 items 3x: 8 items 2x: 6 items 1x: 83 items | 3x: 1 items 2x: 8 items 1x: 64 items |
| upc | 4x: 3 items 2x: 11 items 1x: 88 items | 5x: 1 items 4x: 1 items 3x: 7 items 2x: 6 items 1x: 78 items | 2x: 6 items 1x: 50 items |
| dcu | 4x: 2 items 3x: 6 items 2x: 12 items 1x: 99 items | 5x: 1 items 4x: 2 items 3x: 8 items 2x: 7 items 1x: 81 items | 3x: 3 items 2x: 8 items 1x: 49 items |
| cued | 4x: 4 items 3x: 6 items 2x: 14 items 1x: 91 items | 5x: 2 items 4x: 5 items 3x: 2 items 2x: 10 items 1x: 91 items | 3x: 3 items 2x: 7 items 1x: 60 items |
| rbmt4 | 5x: 1 items 4x: 1 items 3x: 7 items 2x: 10 items 1x: 92 items | 6x: 1 items 4x: 2 items 3x: 8 items 2x: 6 items 1x: 89 items | 3x: 2 items 2x: 3 items 1x: 63 items |
| limsi | 5x: 1 items 4x: 6 items 3x: 3 items 2x: 8 items 1x: 100 items | 7x: 1 items 5x: 2 items 4x: 3 items 3x: 4 items 2x: 12 items 1x: 94 items | 3x: 1 items 2x: 4 items 1x: 58 items |
| rbmt5 | 4x: 1 items 3x: 7 items 2x: 16 items 1x: 86 items | 4x: 2 items 3x: 8 items 2x: 7 items 1x: 92 items | 2x: 8 items 1x: 43 items |
| saar | 5x: 2 items 4x: 3 items 3x: 6 items 2x: 15 items 1x: 73 items | 6x: 2 items 5x: 2 items 4x: 2 items 3x: 6 items 2x: 14 items 1x: 85 items | 3x: 2 items 2x: 8 items 1x: 65 items |
| uedin | 5x: 1 items 4x: 2 items 3x: 11 items 2x: 9 items 1x: 91 items | 4x: 6 items 3x: 4 items 2x: 11 items 1x: 85 items | 4x: 1 items 3x: 3 items 2x: 5 items 1x: 56 items |
| rbmt6 | 5x: 1 items 4x: 1 items 3x: 6 items 2x: 16 items 1x: 106 items | 6x: 1 items 5x: 1 items 4x: 5 items 3x: 4 items 2x: 10 items 1x: 96 items | 3x: 2 items 2x: 6 items 1x: 59 items |
| cmu-smt | 5x: 1 items 4x: 2 items 3x: 9 items 2x: 9 items 1x: 101 items | 6x: 1 items 5x: 1 items 4x: 4 items 3x: 6 items 2x: 8 items 1x: 94 items | 3x: 1 items 2x: 6 items 1x: 66 items |
| System | CONSTITUENT_ACCEPT | CONSTITUENT_NORMALIZED | RANK_NORMALIZED |
|---|---|---|---|
| saar | 6x: 1 items 5x: 1 items 4x: 1 items 3x: 7 items 2x: 15 items 1x: 99 items | 4x: 5 items 3x: 10 items 2x: 8 items 1x: 106 items | 4x: 1 items 3x: 2 items 2x: 6 items 1x: 56 items |
| rbmt5 | 5x: 1 items 4x: 3 items 3x: 4 items 2x: 13 items 1x: 100 items | 5x: 1 items 4x: 5 items 3x: 7 items 2x: 13 items 1x: 91 items | 4x: 1 items 3x: 1 items 2x: 5 items 1x: 62 items |
| rbmt3 | 6x: 1 items 4x: 2 items 3x: 3 items 2x: 16 items 1x: 92 items | 7x: 1 items 5x: 1 items 4x: 2 items 3x: 8 items 2x: 14 items 1x: 111 items | 3x: 2 items 2x: 6 items 1x: 56 items |
| rbmt6 | 5x: 4 items 4x: 4 items 3x: 5 items 2x: 12 items 1x: 88 items | 6x: 1 items 5x: 3 items 4x: 4 items 3x: 6 items 2x: 14 items 1x: 86 items | 3x: 2 items 2x: 8 items 1x: 57 items |
| cued-contrast | 6x: 1 items 4x: 2 items 3x: 4 items 2x: 14 items 1x: 90 items | 4x: 6 items 3x: 5 items 2x: 10 items 1x: 95 items | 2x: 7 items 1x: 57 items |
| ucb | 4x: 3 items 3x: 9 items 2x: 14 items 1x: 89 items | 5x: 2 items 4x: 5 items 3x: 8 items 2x: 14 items 1x: 103 items | 3x: 2 items 2x: 8 items 1x: 63 items |
| upc | 5x: 2 items 4x: 3 items 3x: 5 items 2x: 11 items 1x: 76 items | 5x: 1 items 4x: 5 items 3x: 7 items 2x: 10 items 1x: 80 items | 3x: 1 items 2x: 5 items 1x: 65 items |
| rbmt4 | 6x: 1 items 4x: 6 items 3x: 4 items 2x: 12 items 1x: 88 items | 5x: 2 items 4x: 5 items 3x: 6 items 2x: 12 items 1x: 96 items | 2x: 14 items 1x: 64 items |
| limsi | 5x: 2 items 4x: 5 items 3x: 3 items 2x: 12 items 1x: 85 items | 8x: 1 items 5x: 3 items 4x: 1 items 3x: 8 items 2x: 13 items 1x: 118 items | 3x: 3 items 2x: 6 items 1x: 66 items |
| cmu-smt | 4x: 2 items 3x: 5 items 2x: 12 items 1x: 99 items | 5x: 1 items 4x: 4 items 3x: 5 items 2x: 13 items 1x: 105 items | 3x: 1 items 2x: 5 items 1x: 60 items |
| uedin | 5x: 1 items 4x: 3 items 3x: 7 items 2x: 15 items 1x: 96 items | 6x: 2 items 5x: 1 items 4x: 3 items 3x: 12 items 2x: 10 items 1x: 115 items | 4x: 1 items 2x: 5 items 1x: 68 items |
| cued | 5x: 1 items 3x: 4 items 2x: 15 items 1x: 86 items | 7x: 1 items 6x: 1 items 5x: 2 items 4x: 7 items 3x: 4 items 2x: 12 items 1x: 93 items | 3x: 2 items 2x: 6 items 1x: 49 items |
| supported by the EuroMatrix project, P6-IST-5-034291-STP funded by the European Commission under Framework Programme 6 |
|