Please confirm you are human
This browser or connection looks automated. Press and continuously hold the control for 3 seconds to enable Google-hosted web results and, when separately allowed, AI-assisted answers.
A successful check enables 100 search requests. Interactive access does not authorize scraping, systematic collection, or reuse of search output.
News
The Sequence Knowledge - Issue 916: From Thinking Longer to Learning Better
2+ hour, 50+ min ago (257+ words) TheSequence | Jesus Rodriguez The Sequence Knowledge - Issue 916: From Thinking Longer to Learning Better Why test-time compute distillation could turn inference-time reasoning into permanent model capability. There’s a scaling law hiding in your inference bill. The great discovery of the reasoning-model…...
The Sequence Knowledge - Issue 911: Distilling Diffusion and Multimodal Models
1+ week, 2+ hour ago (170+ words) TheSequence | Jesus Rodriguez The Sequence Knowledge - Issue 911: Distilling Diffusion and Multimodal Models Compressing Time, Space, and Alignment Text distillation teaches a smaller model to imitate an answer. Diffusion and multimodal distillation must compress trajectories, distributions, motion, and the semantic geometry…...
The Sequence AI of the Week #908: You Need to Learn About Gemini Robotics
1+ week, 6+ day ago (233+ words) TheSequence | Jesus Rodriguez The Sequence AI of the Week #908: You Need to Learn About Gemini Robotics Google put a walking humanoid inside a single policy, published the reasoning half as an API, and kept the motor half behind a partner…...
The Sequence Knowlege #907: The Brain Transplant: Distilling Transformers Into Other Architectures
2+ week, 2+ hour ago (239+ words) TheSequence | Jesus Rodriguez The Sequence Knowlege #907: The Brain Transplant: Distilling Transformers Into Other Architectures Weird but more common than you think. The type of distillation you were not thinking about. Every form of distillation in this series so far has…...
TheSequence Opinion #904: The Age of Research Is Overrated. AI Engineering Is Winning
2+ week, 5+ day ago (146+ words) Ilya Sutskever recently offered a compact history of modern AI. From roughly 2012 to 2020, he argued, the field lived in an age of research. From 2020 to 2025, it entered an age of scaling. Now we are going back to research—only this…...
The Sequence AI of the Week #903: Laguna, the 118 Billion Parameters that Walks Into a Trillion-Parameter Bar
2+ week, 6+ day ago (212+ words) Take every open-weight model that discloses its parameter count, put total parameters on a log x-axis, put Terminal-Bench 2.1 score on the y-axis, and you get a reasonably tidy cloud sloping up and to the right. Bigger is better. This is…...
The Sequence Radar #901: Last Week in AI: Smarter Models, Physical Machines, and the Expanding AI Stack
3+ week, 2+ day ago (1054+ words) Our series about AI model distillation continues with another exciting technique. The AI of the week covers Poolside’s new Laguna S2.1. The opinion section debates the hot topic about AI research vs. engineering. I would like to share more of that…...
The Sequence Knowledge #898: The Trace Is the Teacher: Distilling Reasoning Into Small Models
4+ week, 2+ hour ago (318+ words) TheSequence | Jesus Rodriguez The Sequence Knowledge #898: The Trace Is the Teacher: Distilling Reasoning Into Small Models From the release of DeepSeek R1, distillation in reasoning models have become one of the most common techniques in frontier AI. In January 2025, DeepSeek took…...
The Sequence Knowledge #886: Demystifying Model Distillation
1+ mon, 2+ week ago (109+ words) The simplest way to understand knowledge distillation is to imagine a very expensive teacher and a very cheap student. The teacher is a large model: smart, slow, high-capacity, expensive to run. The student is smaller: faster, cheaper, easier to deploy,…...
The Sequence Radar #885: Last Week in AI: Models, Games, and the Future of Evaluation
1+ mon, 2+ week ago (851+ words) We continue our series about distillation. In the AI of the week, we discuss Meta’s amazing AutoData paper. In the opinion section, we debate the amazing topic of AI in space. This week in AI had the strange feeling of…...