Meta Ray-Ban smart glasses get real-time AI video

Meta’s Ray-Ban Meta smart glasses are getting several new AI-powered upgrades, including the ability to have an ongoing conversation and translate between languages.

Ray-Ban Meta owners in Meta’s early access program for the U.S. and Canada can now download firmware v11, which adds “live AI.”

According to a report by TechCrunch, the live AI lets wearers continuously converse with Meta’s AI assistant, Meta AI, to reference things they discussed earlier in the conversation. Without having to say the “Hey, Meta” wakeword, wearers can interrupt Meta AI to ask follow-up questions or change the topic.

Live AI also works with real-time video. Wearers can ask questions about what they’re seeing in real time — for example, what’s around their neighborhood.

Real-time AI video for Ray-Ban Meta was a significant focus of Meta’s Connect dev conference early this fall. Positioned as an answer to OpenAI’s Advanced Voice Mode with Vision and Google’s Project Astra, the tech allows Meta’s AI to answer questions about what’s in view of the glasses’ front-facing camera.