NADI Shared Tasks

Subtask 1 (Closed Country-level Dialect ID) Leaderboard

Rank	Team	F1	Accuracy	Precision	Recall
1	NLPeople	87.27	87.22	87.37	87.22
2	rematchka	86.18	86.17	86.29	86.17
3	Arabitools	85.86	85.81	86.10	85.81
4	SANA	85.43	85.39	85.60	85.39
5	Frank	84.76	84.75	84.95	84.75
6	ISL-AAST	83.73	83.67	83.87	83.67
7	UoT	82.87	82.86	83.17	82.86
8	AIC	82.37	82.42	82.57	82.42
9	Cordyceps	82.17	82.14	82.57	82.14
10	DialectNLU	80.56	80.50	80.92	80.50
11	Mavericks	76.65	76.47	77.43	76.47
12	exa	70.72	71.03	72.26	71.03
13	IUNADI	70.22	70.78	71.32	70.78
14	NAYEL	63.09	63.39	63.30	63.39
15	ustdb	62.51	62.17	63.07	62.17
16	Fraunhofer IAIS	29.91	33.14	38.47	31.39

Subtask 2 (Closed Dialect to MSA MT) Leaderboard

Rank	Team	Overall	Egyptain	Emirati	Jordanian	Palestinian
1	UniManc	14.76	16.04	14.30	12.55	13.55
2	Helsinki	14.28	12.22	23.13	11.15	13.42
3	DialectNLU	13.43	11.45	21.59	10.64	12.66
4	rematchka	11.37	11.18	11.99	10.47	10.86
5	Fraunhofer IAIS	5.85	8.08	3.90	4.96	6.01

Subtask 3 (Open Dialect to MSA MT) Leaderboard

Rank	Team	Overall	Egyptain	Emirati	Jordanian	Palestinian
1	UniManc	21.10	17.65	28.46	22.03	17.29
2	Helsinki-NLP	17.69	16.11	25.81	15.60	15.91
3	rematchka	11.37	11.18	11.99	10.47	10.86