Google Gemini API Launches Agentic Video Understanding with Up to 88% Reduction in Token Consumption

Google Gemini API Launches Agentic Video Understanding with Up to 88% Reduction in Token Consumption

2026-09-02 04:13View Original

According to the Google Official Blog, Google has launched the Agentic Video Understanding feature for the Gemini API. This capability enables the model to autonomously determine video analysis strategies: under traditional mode, frames are extracted at a fixed 1 FPS rate and processed in one batch; under the new mode, the model dynamically locates relevant segments along the timeline and selects visual frames, audio clips, or transcribed text based on the query, automatically increasing frame rate during fast-moving actions for re-evaluation. Google’s internal testing shows that with Gemini 3.7 Flash enabled, token consumption drops by up to 88%, analysis cost decreases by up to 66%, and accuracy improves by up to approximately 7% compared to prior versions;

the technology can pinpoint details within less than one second or extract fine-grained information from videos spanning several hours. This innovation embeds into Gemini’s core architecture what developers previously had to manually construct—a two-stage workflow of first locating key moments, then performing detailed inspection. Currently supported across Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite, the feature is available for both uploaded videos and YouTube videos, with no additional fees. It will be integrated into the Gemini App and YouTube’s Ask YouTube functionality in future updates.

Disclaimer: Contains third-party opinions, does not constitute financial advice

Recommended Reading

Roku OS Update Launches Roku Labs Experimental App Hub, Voice Assistant Gains Weather Q&A Capabilities

3 days ago
Roku OS Update Launches Roku Labs Experimental App Hub, Voice Assistant Gains Weather Q&A Capabilities

Flop Labs builds an AI agent compute marketplace, with the FLOP token used to pay for GPU compute power

18 days ago
Flop Labs builds an AI agent compute marketplace, with the FLOP token used to pay for GPU compute power

Caterpillar leverages its automated mining expertise for AI deployment, launching the Cat AI voice assistant and planning a $100 million investment over five years to train employees

21 days ago
Caterpillar leverages its automated mining expertise for AI deployment, launching the Cat AI voice assistant and planning a $100 million investment over five years to train employees

Perplexity's Free Gifting Strategy Pays Off: Indian User Retention Surges Over 5x, Subscription Revenue Rises 60%

08-19
Perplexity's Free Gifting Strategy Pays Off: Indian User Retention Surges Over 5x, Subscription Revenue Rises 60%

Neko Health will open its first U.S. office in New York on September 24, with 250,000 people already queued up to join

08-19
Neko Health will open its first U.S. office in New York on September 24, with 250,000 people already queued up to join

Einride purchases 500 Tesla Semis, managed via the Saga AI platform

08-19
Einride purchases 500 Tesla Semis, managed via the Saga AI platform

Peacock Raises Full-Line Prices by $4, Launches AI-Powered Vertical Video and Real-Time Live Stream Cropping Features

08-19
Peacock Raises Full-Line Prices by $4, Launches AI-Powered Vertical Video and Real-Time Live Stream Cropping Features