Overview of the Collaboration
In a strategic move to advance artificial intelligence, NVIDIA has entered into an engineering-level partnership with Ineffable Intelligence, a London-based AI lab founded by David Silver—the architect behind AlphaGo. The collaboration aims to build the foundational infrastructure for large-scale reinforcement learning (RL), a field where AI systems learn through trial and error, converting raw computational power into novel knowledge.
The Vision of Superlearners
Jensen Huang, founder and CEO of NVIDIA, emphasized the significance of this partnership: “The next frontier of AI is superlearners—systems that learn continuously from experience. We are thrilled to partner with Ineffable Intelligence to codesign the infrastructure for large-scale reinforcement learning as they push the frontier of AI and pioneer a new generation of intelligent systems.”
From Supervised Learning to Experiential AI
David Silver, a pioneering figure in reinforcement learning, articulated the paradigm shift needed: “Researchers have largely solved the easier problem of AI: how to build systems that know all the things humans already know. But now we need to solve the harder problem of AI: how to build systems that discover new knowledge for themselves. That requires a very different approach—systems that learn from experience.”
Technical Challenge: The Reinforcement Learning Pipeline
Unlike conventional pretraining, which uses static human-curated datasets, reinforcement learning generates its own data through continuous interaction with an environment. The system must act, observe, score, and update itself in tight iterative loops. This dynamic process places intense demands on:
- Interconnect speed and bandwidth
- Memory bandwidth for fast data access
- Serving latency to maintain loop cadence
Furthermore, RL systems may train on novel forms of experience—simulated physics, game states, or robotic sensor feeds—that differ significantly from human language or images. This requires innovative model architectures and training algorithms.
Infrastructure Blueprint: Grace Blackwell and Beyond
Engineers from both companies are collaborating on the optimal pipeline design, starting with NVIDIA Grace Blackwell superchips. This initiative will be among the first to explore the upcoming NVIDIA Vera Rubin platform. The goal is to understand the hardware and software requirements as AI moves beyond human-generated data toward models that learn through simulation and direct experience.
Why Infrastructure Matters
Getting the infrastructure right is critical for unlocking unprecedented scales of reinforcement learning in highly complex environments. Such systems could discover breakthroughs across all fields of knowledge, from drug discovery to autonomous systems and game theory.
Conclusion
The NVIDIA-Ineffable Intelligence partnership marks a significant step toward building the next generation of AI—superlearners that continuously create new knowledge from experience. By focusing on the specialized demands of RL pipelines, they aim to enable transformative AI capabilities that extend far beyond current supervised models.