Meta Brings AI Agent Muse to Smart Glasses at Connect 2026

GeoDetect PipelineSeptember 24, 2026
Share

Overview

Meta is expanding the reach of its Muse AI agent beyond smartphones and into the realm of wearable technology. Announced during Meta Connect 2026, the company confirmed that it is actively working to bring the digital assistant to its line of smart glasses. This integration marks a significant step in Meta’s strategy to embed artificial intelligence more deeply into daily routines through head-worn devices.

The move comes just weeks after the initial launch of Muse, which has established itself as a general-purpose AI companion. By adding voice-activated access on Meta Ray-Ban Display glasses and other compatible models, Meta aims to make the agent more hands-free and contextually aware. Users will soon be able to summon Muse simply by saying its name, allowing it to manage complex tasks while their hands remain busy.

Muse Integration on Glass

The primary highlight of the announcement is the seamless integration of Muse with Meta’s hardware ecosystem. According to the company, users will be able to activate the agent directly from their smart glasses using a voice command. This hands-free interaction model is designed to enhance productivity and convenience for users who are on the go.

Once activated, Muse will be capable of handling a variety of practical tasks. These include guiding users through workout routines, logging meals for dietary tracking, and assisting with shopping decisions when users encounter products they are considering. The ability to reference items in the user’s immediate visual field makes the agent particularly useful for real-world decision-making.

Muse is arriving on Meta’s glasses alongside a wave of new accessibility, camera, and navigation features, signaling a shift toward more holistic wearables.

This expansion leverages the visual capabilities of the glasses, allowing the AI to understand not just what the user is doing, but what they are looking at. It represents a natural evolution from text-based prompts to a more intuitive, multimodal interface where the boundary between the digital assistant and the physical environment is blurred.

Enhanced Accessibility and Audio Features

Beyond the AI agent, Meta unveiled a suite of updates designed to make its smart glasses more accessible and versatile. A major addition is the Hearing Enhancement feature, which Meta has described as FDA-cleared software for adults with perceived mild to moderate hearing loss. This tool aims to democratize hearing assistance technology by integrating it directly into everyday eyewear.

The Hearing Enhancement feature will be available later this year. Customers can access it through a Meta One subscription or as a one-time $149 add-on for compatible glasses. This pricing structure offers flexibility for users who may not want to commit to a recurring service fee.

Additionally, Meta AI on the glasses will provide more context-rich answers when users ask the device what it is seeing. This improvement is expected to significantly benefit blind and low-vision users by helping them interpret their surroundings with greater accuracy and detail. To further refine the audio experience, a new customization feature will allow users to adjust volume independently between their left and right ears, including the option to route all audio to one side.

Camera and Photography Upgrades

Meta is also introducing notable improvements to the photo and video capabilities of its smart glasses. The new Dolby Atmos Capture feature will enable users to record videos with 360-degree spatial audio. This immersive audio technology aims to create a more realistic recording experience, preserving the sense of space and direction in sound.

For photography, a new Dynamic Photo feature automatically captures multiple frames when a user takes a picture. Meta AI then analyzes these frames to suggest the best image from each batch. This ensures that users are less likely to miss a perfect shot due to blinking or motion blur, streamlining the process of getting high-quality photos.

Navigation and Display Innovations

For users of the Meta Ray-Ban Display glasses, several new heads-up navigation features are on the horizon. Starting later this month, users in the US and Canada will be able to use voice commands to request real-time directions for cycling or public transit. This expands the utility of the glasses beyond simple walking navigation.

A standout innovation is the shift toward landmark-based guidance. Rather than relying solely on traditional turn-by-turn street directions, the new system will reference objects in the user’s physical environment, such as a specific house, car, or landmark. This approach is designed to make navigation more intuitive and easier to follow in complex urban environments.

Other upcoming features for the Display glasses include:

  1. On-device photo editing, allowing users to tweak images directly on the glasses’ display.
  2. An “Explore” app for discovering new applications and capabilities.
  3. An improved calendar interface for better schedule management.
  4. Phone notification mirroring to keep users informed without checking their phones.

Finally, the Hologram feature, previously announced for new VR Glasses, is rolling out to Meta Ray-Ban Display users in Early Access via WhatsApp. This feature creates a photorealistic digital representation of the user’s face during calls, inferring expressions from voice to provide a more engaging virtual presence.

Share

Sources

Tools mentioned