machine learning
6 posts · all topics
-
Why a language model can know who Tom Cruise's mother is but not who her son is
Language models trained on a fact written one way, 'A is B', often cannot answer the same fact asked the other way round. Three research groups have reproduced this 'reversal curse'; the open question is how much it matters once facts appear in many phrasings.
-
Preprint: reinforcement learning made AI agents better at recovering, not at each step
Researchers at the Chinese Academy of Sciences and Tsinghua report that training Qwen3 agents with multi-turn reinforcement learning barely improved their individual moves but made them much better at getting back on track after a mistake. The work is a preprint and has not been independently reproduced.
-
Why making a model bigger can make it worse, then better again
Classical statistics says test error should rise once a model is flexible enough to memorise its training data. Experiments since 2018 show a second fall in error beyond that point, called double descent; the pattern is well documented, but how much it matters in practice is still argued over.
-
Do AI models decay when they learn from each other?
A 2024 Nature paper showed that generative models trained repeatedly on their own output lose the rare parts of what they learned. A follow-up argued that the outcome depends heavily on whether synthetic data replaces real data or is added to it.
-
Why language models lose track of the middle
Language models that accept very long inputs tend to use information at the start and end better than information in the middle. The effect is well documented; how much of it survives in newer models is less clear.
-
How big should a language model be for the compute you have?
Two influential papers fitted simple laws to predict how AI language models improve with size, data and computing power, and gave very different advice on how to split a budget. The later answer, from DeepMind's Chinchilla work, has largely held up, though one of its own fits turned out to be flawed.