Microsoft Edge to Translate and Dub YouTube Videos During Playback: A New AI Feature Unveiled at Build Event

In a remarkable advancement, Microsoft Edge is set to offer real-time video translation on platforms such as YouTube, LinkedIn, and Coursera. This announcement was made at this year's Microsoft Build event, showcasing a new AI-powered feature capable of translating and dubbing voice content live during video playback.

Currently, this feature supports translations from Spanish to English, as well as from English to German, Hindi, Italian, Russian, and Spanish. This new function aims to make video content more accessible not only by translating videos into the user's native language but also by enhancing accessibility for those with hearing impairments.

Additionally, Edge will extend this real-time translation capability to videos on news websites like Reuters, CNBC, and Bloomberg. Microsoft plans to expand the range of supported languages and websites in the future.

This feature adds to a suite of AI capabilities that Microsoft has incorporated into Edge through integration with Copilot. While Edge already offers the ability to summarize YouTube videos, it cannot generate text summaries for each video as it relies on the video transcript to create summaries. This development represents a significant step forward in making digital content more accessible and understandable across different languages and for users with varying needs.