back

AI Engineering with the Google Gemini 2.5 Model Family – Philipp Schmid, Google DeepMind

Gemini 2.5: breaking AI engineering barriers

Google's Gemini 2.5 marks a significant leap forward in how developers can build with multimodal AI models. In his presentation, Philipp Schmid from Google DeepMind unveils how Gemini 2.5's architecture eliminates previous constraints around context windows and input processing, offering a new paradigm for AI engineering that combines unprecedented flexibility with simplified development approaches.

The video delves into Google's latest Gemini model family, emphasizing how these advances are transforming how developers build AI applications. Schmid, clearly enthusiastic about these developments, walks through the architectural improvements that address persistent challenges in working with large language models while showcasing practical applications that demonstrate genuine capability leaps rather than incremental improvements.

  • Gemini 2.5 introduces a "windowless" architecture that effectively eliminates traditional context window constraints, allowing processing of inputs up to 2 million tokens without degradation in performance
  • The model family features true multimodality, handling text, images, audio, and video with equal proficiency through a unified architecture, rather than treating different input types as separate processes
  • Google has simplified the developer experience with consistent APIs across all model sizes (Flash, Pro, Ultra), enabling easier scaling and deployment while maintaining strong alignment between model capabilities and outputs

The end of context windows changes everything

The most revolutionary aspect of Gemini 2.5 is how it fundamentally rethinks the concept of context windows. This isn't just a technical improvement—it represents a paradigm shift in how AI systems process information. Traditional LLMs have always been constrained by fixed context windows, forcing developers to implement complex chunking strategies and retrieval augmentation techniques. Gemini 2.5's architecture effectively eliminates this limitation.

This matters tremendously because it removes what has been perhaps the most significant engineering bottleneck in building practical AI applications. When systems can process massive amounts of information at once—like entire codebases, lengthy legal documents, or comprehensive medical histories—without information loss at window boundaries, applications can become dramatically more capable while requiring less engineering overhead. The demonstrations showing performance consistency across 10K, 1M and even 2M tokens suggest that the common practice of retrieval-augmented generation (RAG) might become unnecessary for many use cases,

Recent Videos

May 6, 2026

Hermes Agent Master Class

https://www.youtube.com/watch?v=R3YOGfTBcQg Welcome to the Hermes Agent Master Class — an 11-episode series taking you from zero to fully leveraging every feature of Nous Research's open-source agent. In this first episode, we install Hermes from scratch on a brand new machine with no prior skills or memory, walk through full configuration with OpenRouter, tour the most important CLI and slash commands, and run our first real task: a competitor research report on a custom children's book AI business idea. Every future episode will build on this fresh install so you can see the compounding value of the agent in real time....

Apr 29, 2026

Andrej Karpathy – Outsource your thinking, but you can’t outsource your understanding

https://www.youtube.com/watch?v=96jN2OCOfLs Here's what Andrej Karpathy just figured out that everyone else is still dancing around: we're not in an era of "better models." We're in a different era of computing altogether. And the difference between understanding that and not understanding it is the difference between being a vibe coder and being an agentic engineer. Last October, Karpathy had a realization. AI didn't stop being ChatGPT-adjacent. It fundamentally shifted. Agentic coherent workflows started to actually work. And he's spent the last three months living in side projects, VB coding, exploring what's actually possible. What he found is a framework that explains...

Mar 30, 2026

Andrej Karpathy on the Decade of Agents, the Limits of RL, and Why Education Is His Next Mission

A summary of key takeaways from Andrej Karpathy's conversation with Dwarkesh Patel In a wide-ranging conversation with Dwarkesh Patel, Andrej Karpathy — former head of AI at Tesla, founding member of OpenAI, and creator of some of the most popular AI educational content on the internet — shared his views on where AI is headed, what's still broken, and why he's now pouring his energy into education. Here are the key takeaways. "It's the Decade of Agents, Not the Year of Agents" Karpathy's now-famous quote is a direct pushback on industry hype. Early agents like Claude Code and Codex are...