Two embedding clouds rotating into alignment, with English/Italian word pairs

Word Translation Without Parallel Data: A Beautiful Application of GANs and Linear Algebra

Three beauties meet in this paper. Words in one language end up internally aligned by meaning. For languages with shared structure, that arrangement is shaped almost the same way across both. A GAN and an SVD recover the rotation between them, strongly for close pairs, weakly for distant ones, with no parallel text.

May 26, 2026 · 24 min