Adding captions to audio and video is a major accessibility goal, allowing people with different abilities to consume and understand audio and video content. The holy grail has always been live captioning of content in real-time, and with the Pixel 4 Google is now one step closer to that reality.
Google’s new Live Caption, unveiled a few months ago but featured in the 2019 Made by Google Event, is now available and can automatically live caption all video and audio content on your device or the cloud.
Thanks to the new Neural Core on the Pixel 4, you can even live caption content stored on your phone without any network access – as long as it’s in English.
The only real exception to Live Caption’s current abilities is that it won’t work with live phone and video calls, this a hurdle we’re sure Google will overcome in time. Activating Live Caption does come with a warning that it will consume more battery, but for many the tradeoff might well be worth it.
In addition to Pixel 4, Live Caption will roll out to Pixel 3, Pixel 3 XL, Pixel 3a and Pixel 3a XL later this year, and Google says it’s working closely with other manufacturers to make it more widely available in the coming year.
Actually Google have the ability for a while now – was in limited release on a version of Hangouts only available to G Suite customers, from what I understand, Maybe trialling it here!
I agree, pretty amazing. Maybe they can commercialise this for the TV networks, where the text at the bottom of the screen is always 5 or more seconds behind the spoken voice. Would be beneficial in football games as well.