Tag: VisualDub

  • Indian startup claims to solve Bollywood’s dubbing dilemma with AI lip-syncing

    Indian startup claims to solve Bollywood’s dubbing dilemma with AI lip-syncing

    MUMBAI: An Indian artificial intelligence startup reckons it has cracked one of cinema’s most vexing problems: making dubbed films look authentic. NeuralGarage’s VisualDub technology has been deployed on War 2, releasing on 14 August, to create what the company claims is the world’s first film visually transformed from one language to another whilst maintaining the illusion of native production.

    The Bollywood sequel, originally shot in Hindi, has secured a straight film certificate for Telugu distribution—not as a dubbed version but as an ostensibly original Telugu production. Neural Garage co-founder & chief executive Mandar Natekar describes this as a “fundamental shift” in content production and distribution.

    The technology addresses a chronic irritant in global film distribution: poorly synchronised dubbing that breaks audience immersion. Traditional dubbing overlays foreign-language audio whilst retaining the original actor’s mouth movements, creating a jarring disconnect that many viewers find off-putting.

    VisualDub purports to solve this by digitally altering actors’ facial movements to match the target language’s phonetic patterns, creating the visual impression that performers originally spoke in the dubbed tongue. The result, Natekar claims, allows producers to sell multilingual versions as distinct original films rather than mere translations.

    The commercial implications could be substantial. Indian cinema’s linguistic fragmentation has long constrained box office potential, with Hindi films struggling in southern states where Telugu, Tamil and other regional languages dominate. Conversely, southern blockbusters rarely achieve pan-Indian success without extensive dubbing campaigns.

    If VisualDub delivers on its promises, producers could command premium pricing for what appears to be multiple “native” productions whilst incurring costs for just one shoot. Natekar suggests this could double or treble pre-release distribution revenues.

    The startup, which has garnered backing from Google’s GenAI Accelerator and AWS’s Global GenAI programme, also won TechCrunch’s Battlefield competition in 2024 and this year’s SXSW innovation award. Such endorsements suggest the technology has impressed seasoned investors and technologists.

    Yet scepticism is warranted. Previous attempts to digitally manipulate actor performances—from CGI de-aging to deepfake technology—have often fallen into the “uncanny valley”, where near-human animations feel disturbingly artificial. Moreover, the cultural nuances embedded in regional cinema extend far beyond language, encompassing gestures, expressions and performance styles that may prove difficult to algorithmically adjust.

    The broader implications stretch beyond Bollywood. Hollywood studios spend millions dubbing blockbusters for international markets, whilst streaming platforms like Netflix invest heavily in local-language content production. A reliable visual dubbing solution could dramatically reduce these costs whilst expanding addressable audiences.

    Natekar envisions actors transcending linguistic boundaries entirely: “Hrithik Roshan can now be a Telugu, Tamil, or even a Spanish actor. Tom Cruise in Bhojpuri? Now possible.”

    Such grandiose claims invite scrutiny. The proof will lie not in technical demonstrations but in audience acceptance. If War 2 performs strongly in Telugu markets without viewers detecting artificial manipulation, VisualDub may indeed herald a new era in global content distribution.

    For now, the technology represents another front in artificial intelligence’s assault on creative industries. Whether it liberates content from linguistic constraints or merely creates more sophisticated fakery remains to be seen. What’s certain is that traditional dubbing studios should be paying attention.

  • NeuralGarage finalist at SXSW Pitch 2025 with revolutionary VisualDub tech

    NeuralGarage finalist at SXSW Pitch 2025 with revolutionary VisualDub tech

    MUMBAI: For NeuralGarage, to revolutionise entertainment, the answer lies in VisualDub, its groundbreaking technology addressing the age-old problem of visual dissonance in dubbed content.

    Now, this Bangalore-based Generative AI start-up is set to showcase its innovation on the global stage as a finalist at SXSW Pitch 2025, competing in the ‘Entertainment, Media, Sports & Content’ category.

    VisualDub synchronises the lips and jaw movements of actors with dubbed audio, creating a seamless viewing experience for audiences without compromising the original resolution. Built for films, streaming platforms, broadcast networks, and advertising, this technology transforms how content is localised, enabling brands to produce native, authentic visuals in multiple languages—without skyrocketing production costs.

    “VisualDub is production-ready and meets the exacting standards of the entertainment industry,” said NeuralGarage co-founder & CEO Mandar Natekar. “Generative AI will rapidly change the way content is created, distributed, and consumed. With VisualDub, we are poised to drive this change from the front. We can’t wait to showcase the full spectrum of our technology at SXSW 25 in their pitch event.”

    VisualDub already has a proven track record, having been used by major global brands to adapt ad films into multiple languages seamlessly. This innovation reduces the need for costly re-shoots while delivering content that feels native and immersive to diverse audiences.

    VisualDub is the brainchild of IIT Kanpur alumni Subhabrata Debnath, Subhashish Saha, and Anjan Banerjee, along with media veteran Mandar Natekar. Together, they have built a product that has the potential to reshape the global entertainment and media landscape.

    On 8-9 March 2025, NeuralGarage will pitch VisualDub before a live audience of expert judges, including heavyweights like Esther Dyson of Wellville, Arlan Hamilton of Backstage Capital, and Jessica Robinson of Assembly Ventures. Hosted by Jim Breyer of Breyer Capital, SXSW Pitch promises unparalleled exposure to Hollywood power players and global investors.

    In an age where content localisation is a must for global reach, VisualDub offers a revolutionary way to make dubbed content visually cohesive and engaging. Will it win over the SXSW judges? With its cutting-edge technology and strong use cases, NeuralGarage is ready to take the leap.

  • NeuralGarage and UFO Moviez announce partnership

    NeuralGarage and UFO Moviez announce partnership

    Mumbai: In a global first, NeuralGarage, a Bangalore-based Generative AI company has collaborated with UFO Moviez, India’s largest digital cinema distribution network and in-cinema advertising platform, showcasing the way how GenAI technology can be brought to its customers directly paving the way for mass adoption.

    Today, audiences have access to a vast pipeline of world-class content dubbed in different languages. However, a significant flaw destroys the viewing experience: the mismatch between the actors’ lip and jaw movements and the dubbed audio. This lack of synchronization between the spoken visual expression & the dubbed audio creates a disjointed and often distracting experience for non-native viewers and takes them away from an authentic cinematic experience.

    This is where VisualDub creates magic. VisualDub, NeuralGarage’s proprietary technology, transforms the facial expression of the actors by syncing their lip movements, including smile lines, micros muscles and movements in the cheeks, mouth, chin, and upper neck – with the dubbed audio resulting in the film authentically looking as if it has been shot in the language of the dub. This transformation preserves the original resolution and color of the film including background across every frame. Importantly, it retains the natural performance of the actors throughout.

    UFO Moviez has exclusive rights to bring this technology to film studios & film producers releasing their films in India across all languages. This collaboration is set to transform the way film goers watch films which have been dubbed and brings an authentic viewing experience to them through the usage of GenAI technology.

    Commenting on the development, Neural Garage co-founder & CEO Mandar Natekar said,  “VisualDub has been built keeping in mind the exacting expectations from actors, film studios & producers preserving the cinematic expression as the original. The complex Generative AI technology that we have built ensures that visual integrity is retained across every frame and audiences have a mind-blowing experience watching their favorite film in a language of their choice, without the barrier of visual discord that comes in when films are dubbed. We are excited to collaborate with UFO Moviez to bring their technology to the film industry in India. UFO, with their massive network in the film production & distribution fraternity, are the best partners we could have imagined and together with them, we will bring this technology to the film industry at a rapid pace.”

    UFO Moviez executive director & group CEo Rajesh Mishra said – “This partnership marks a significant milestone in the industry, showcasing the capabilities of a completely India-based Generative AI startup in solving one of the biggest problems in film making when they are dubbed into multiple languages. As NeuralGarage and UFO Moviez join forces, audiences can look forward to a new era of multi lingual visual content that feels natural and authentic, setting the stage for future innovations that will further enhance the viewing experience for lovers of cinema across the world.”