Mistral releases LIDstral-Arabic, a language and dialect classifier for Arabic-script text
Original titlemistralai/LIDstral-Arabic
AISummary
Mistral AI has released LIDstral-Arabic, a fast classifier that identifies Modern Standard Arabic, Arabic dialects, and non-Arabic languages written in Arabic script across 51 classes.
On Moroccan Darija, it scores 88.67% F1, versus 72.65% for LahjatBERT ALDi CL and 71.28% for GlotLID v3, across 84,870 evaluation examples. The model runs on CPU and is available from a private Hugging Face repository under Apache 2.0.
Source: Mistral AI · new models on Hugging Face · huggingface.coPublished · added here