Wals Roberta Sets 37-70.zip Apr 2026

: Definite (37A) and Indefinite (38A) article systems.

The "RoBERTa" designation suggests this data has been pre-processed or formatted for use with the (Robustly Optimized BERT Pretraining Approach) large language model, likely for tasks like cross-lingual transfer or testing a model's metalinguistic knowledge. Included Linguistic Features (Chapters 37–70) WALS roberta sets 37-70.zip

: Inclusive/exclusive distinctions (39A–40A), distance contrasts in demonstratives (41A), and third-person pronouns (43A). : Definite (37A) and Indefinite (38A) article systems

: Testing if models like RoBERTa or XLM-RoBERTa have "learned" the typological rules of specific languages during pre-training. : Testing if models like RoBERTa or XLM-RoBERTa

: Perfective/imperfective aspect (65A), past tense (66A), future tense (67A), and the perfect (68A).

: Noun phrase conjunction (63A) versus verbal conjunction (64A). Verbal Categories (Chapters 65–70) :

: Leveraging the broad cross-linguistic data in WALS to improve how models handle the hundreds of languages that lack large amounts of training text.