Meta Unveils Major Muse AI Upgrades at Connect

Overview

Meta has launched a significant expansion of its Muse AI agent platform during its annual Connect conference in Menlo Park. Just weeks after the agent’s initial release, the company unveiled a suite of new capabilities designed to integrate Muse deeper into users’ daily digital lives. CEO Mark Zuckerberg framed these updates as a central pillar of Meta’s strategy, declaring that the firm is “going all-in” on its consumer AI ambitions.

The upgrades signal Meta’s intent to compete directly with other major players in the agentic AI space. By adding real-time video avatars, hardware integrations with smart glasses, and broader desktop automation, Meta aims to transform Muse from a simple chat assistant into a comprehensive personal superintelligence. Zuckerberg predicted that Muse would eventually become a tool used by billions to accomplish goals and improve their lives.

Strategic Vision and Monetization

During his keynote, Zuckerberg emphasized that Muse is not merely a feature but the centerpiece of Meta’s future AI vision. Dressed casually in khakis and a T-shirt reading “Building is My Love Language,” he outlined a roadmap where the agent evolves to handle increasingly complex tasks across all user devices.

“The centerpiece of our vision for what we’re building is Muse,” Zuckerberg said. “In the coming years, I expect that Muse is going to grow into the personal superintelligence that billions of people around the world are going to use to accomplish their goals and improve their lives.”

A key component of this strategy is Muse Spark, Meta’s multimodal AI model specifically engineered for agentic work. Unlike some competitors who position their agents as specialized tools, Meta is marketing Muse as an accessible, all-encompassing helper capable of automating the busy work of everyday life from day one.

Regarding monetization, Zuckerberg clarified that Meta will initially offer Muse for free for a substantial number of tokens. The long-term business model relies on taking a small fee from transactions facilitated through the agent, rather than charging direct subscription costs. This approach mirrors strategies employed by other tech giants seeking to lock users into ecosystem-wide services.

New Features and Hardware Integration

The Connect event highlighted several groundbreaking features that extend Muse beyond the screen and into physical reality. Among the most notable announcements is the introduction of Muse Realtime Avatar, a new AI model that allows users to create a distinct digital persona for their agent.

The Digital Avatar Experience

For the first time, Muse will have a face, body, and voice, making interactions significantly more personable. Users will be able to engage in real-time video chats with their personalized avatar. During the keynote demo, Zuckerberg showcased how users can assign tasks and ask questions to their agent while maintaining eye contact and receiving natural visual feedback.

This feature introduces a layer of visual interactivity that some observers compared to the “Metaverse” aesthetic Meta previously championed. However, the company positions it as a practical advancement in human-computer interaction rather than a virtual reality exercise.

Smart Glasses Integration

Meta also confirmed that Muse will soon be available on its line of smart glasses. This integration allows users to control their agent via voice commands without needing to look at a screen. Once activated by a wake word, Muse can guide users through personalized workouts, log meals, book appointments, and assist with purchases based on what the user sees through the glasses.

The agent is designed to operate in the background, checking in with the user only when tasks are complete or further input is required. While Meta did not provide a specific launch date, executives indicated that this feature would roll out in the “coming months.”

Desktop Automation and Developer Ecosystem

Expanding beyond mobile and wearable devices, Meta announced that Muse will now support Mac computers. This move allows users to delegate complex workflows to the agent, enabling it to operate any application on the desktop.

Computer Control Capabilities

Alexandr Wang, Meta’s chief AI officer, demonstrated how Muse can run tasks in the background while users step away from their computers. Whether managing a small business or handling administrative work, the agent can process queued jobs autonomously.

To support this background functionality, Muse will soon receive its own dedicated email address. This allows the agent to manage its own communications, receive task assignments, and interact directly with email threads. Users will be able to forward emails to Muse for processing or add the agent to existing conversations to automate responses and scheduling.

Retail and Developer Partnerships

Meta has secured partnerships with major retailers and payment processors to facilitate e-commerce through Muse. Integrations with Shopify, Stripe, PayPal, and Lync enable the agent to access product catalogs and complete purchases across the internet.

New retail partners include Best Buy, Gap, Sephora, Walmart, and Wayfair. Additionally, Muse will connect with travel platform Expedia and grocery service Instacart soon. These connectors allow the agent to handle end-to-end shopping experiences, from discovery to checkout.

Recognizing the importance of a broad ecosystem, Meta has opened its platform to developers to build custom connectors. The response has been swift, with over 1,500 applications received in less than a week. Wang described this as a “generational opportunity” to build for a new computing platform as it takes off.