Technology
Apple researchers propose LINK method to boost multilingual knowledge transfer with lexical substitutions
Apple researchers introduced LINK, a pretraining data intervention that swaps English words with translations from bilingual vocabularies to improve knowledge transfer to low-resource languages. The method needs no extra training or parallel data and shows up to 2x faster convergence on downstream tasks across eight languages.