Zee5 has partnered with Google Cloud to launch an AI-powered short-video feature called Clips, designed to automatically identify notable moments from movies and shows and turn them into vertical videos.
The feature aims to make Zee5’s large catalogue of long-form content easier to discover through a swipe-based short-video experience. Instead of searching through an entire movie or series, users can first come across individual scenes and then move directly to the complete title if they want to watch more.
The system combines several Google Cloud technologies, including Gemini Pro, the Chirp multilingual model, Speech-to-Text, Cloud Vision API and deep-learning models. Zee5 said these technologies allow the platform to analyse long-form content, identify moments that could attract viewers and create short vertical clips at scale.
How Zee5 Clips Works
Clips follows a format similar to other short-video feeds. Users can swipe through short scenes taken from Zee5’s content library and move to the full movie or show when a particular clip interests them.
The connection between short-form and long-form viewing is central to the feature. By presenting individual scenes first, Zee5 aims to help viewers discover titles they may not have actively searched for.
According to the company, early viewing behaviour has already shown users moving from Clips to full-length content.
Pramod Prakash, Chief Technology Officer at Zee Entertainment Enterprises Ltd., said the feature was developed around the need to make it easier for audiences to discover stories they might otherwise miss.
He said AI is used to identify potentially engaging portions of long-form content and automatically transform them into vertical videos.
Gemini and AI Models Handle Content Analysis
Google Cloud’s Gemini models are part of the technology powering the Clips workflow. The Chirp multilingual model handles speech-related processing, while Speech-to-Text and Cloud Vision API help analyse audio and visual elements within the original content.
This allows lengthy movies and multi-episode series to be processed without requiring editors to manually identify and cut every short segment.
Tejkarran Singh Bajaj, Business Head, Zee5 India and AI & Innovation, said Clips offers viewers another way to encounter stories that they may not have specifically searched for.
The technology could also help streaming platforms make larger content libraries easier to navigate. A viewer who might overlook a movie or series while browsing its listing could instead discover it through a short scene and decide to watch the full title.
Short Videos as a New Discovery Route
Amit Kumar, Managing Director, Digital Natives Business at Google Cloud India, said the Zee5 project demonstrates how generative AI can help accelerate the development and rollout of new features on digital platforms.
With Clips, Zee5 is using AI not simply to create short videos but also to connect those short-form experiences with its existing long-form catalogue. The approach gives viewers a swipe-based way to discover content while providing a direct path from an individual scene to the complete movie or show.