Google previews on-demand tool retrieval in the Gemini API

Google launched Tool Retrieval in preview on November 19, letting Gemini API agents load detailed tool definitions only when they need them.
The feature works in the Interactions API with Gemini 3.6 and later models, including all Gemini 4 models, according to Google’s announcement. Agents can initially see a tool’s name and description while leaving its parameter schema out of context. When the model selects a tool, the API retrieves that schema before normal function calling continues.
Developers can also defer tools exposed through remote MCP servers or use their own client-side registry. Client-side searches require an extra round trip. Frequently used tools can remain loaded from the start.
There is no separate retrieval charge, but standard model token billing still applies, including schemas loaded into the conversation. Google recommends measuring savings against actual traffic.
The preview targets a growing expense in agent systems: repeatedly sending large catalogs of mostly unused tools. It reduces unnecessary context without requiring developers to host a search index.
Sources and citations
Revision history
Published .