ElevenLabs opens free ElevenAI early access, adds agent Memory and Routines
ElevenLabs used its New York Summit on November 11, 2026 to open free early access to ElevenAI, a new workplace app that listens to spoken conversations and turns them into notes, summaries and action items. The company presented ElevenAI as an AI teammate for employees, built on its Scribe v3 speech recognition, and said the app can take notes in meetings with everyone's consent and send each attendee a summary and personal action items when the call ends.
The same announcement covered a broad set of changes to the ElevenAgents platform, which companies use to build voice and chat agents for sales, support, recruiting and operations. ElevenLabs described two upcoming agent features, Memory and Routines, previewed an Interaction Engine that manages turn-taking and picks a language model for each step of a conversation, and said it will help businesses fine-tune certain open-source language models and its own voice models in the coming months. It also introduced Scribe v3 Medical, a transcription model for healthcare vocabulary.
On the commercial side, ElevenLabs launched a Partner Program for consultancies, integrators and software vendors, opened an ElevenLabs Marketplace of industry-specific agent applications, announced an alliance with McKinsey and expanded its work with NVIDIA, including 15 MW of new Vera Rubin compute capacity. Of all these items, only ElevenAI early access, the Partner Program, the Marketplace and the Nemotron 3.5 Super VL model inside ElevenAgents are described as available now; Memory, Routines and fine-tuning carry no launch date, and Marketplace purchasing is planned for next year.
··········
ELEVENAI: WHAT THE NEW MEETING AND DICTATION APP DOES.
ElevenAI is the most visible product of the Summit because it moves ElevenLabs from developer infrastructure into an app that individual employees use directly. According to the company, ElevenAI listens to spoken conversations, including in-person meetings, and turns them into notes and next steps. It offers dictation and meeting notes powered by Scribe v3, the speech-to-text model ElevenLabs released this week, which the company says cuts word errors by 27% against Scribe v2 in multilingual tests. Our coverage of Scribe v3 and its $0.20-an-hour pricing describes the model in detail.
In a meeting, ElevenAI takes notes with the consent of the participants and, when the call ends, delivers a summary and a list of action items for each attendee. ElevenLabs also says the app can give live assistance during a call by surfacing context, so that people and agents can work on the same task while the conversation is still going. The company stresses that notice and consent mechanisms are built into the product.
The responsible-use guide that ElevenLabs published for the beta adds practical detail missing from the announcement. Google Meet is the primary compatible app during the beta, and ElevenAI displays a notice in the Google Meet chat and on video. When the camera is off or unavailable, as on an audio-only WhatsApp call, the app may ask for an audible statement from the user at the start of the call. The guide tells users to announce ElevenAI at the start of every meeting, repeat the notice for late joiners and phone participants, stop transcription if anyone objects, and avoid large open meetings or sensitive meetings about health, finances, privileged legal matters or children unless their agreement with ElevenLabs expressly allows it.
ElevenLabs has not published desktop or mobile availability, plan names, usage limits or a price for ElevenAI after early access. The early access itself is free.
··········
ELEVENAI TERMS OF SERVICE: DATA, CONSENT AND BETA LIMITS.
The ElevenAI terms of service, dated November 11, 2026, answer several questions that companies will ask before letting staff record meetings with a new tool. The most relevant clauses for business buyers are summarized below.
........
Topic | What the ElevenAI terms say |
Model training | ElevenLabs will not use customer content for model training |
Data retention | Content is not retained after delivery except as needed or required by law |
Recording consent | The user is solely responsible for notices and legally required consents |
Covert recording | Prohibited |
Restricted data | No protected health information without a BAA, no financial or government identifiers |
Who can use it | Business or professional use only, users 18 or older |
Beta status | For evaluation, not production use, provided as is |
Free plans | ElevenLabs may change how much time ElevenAI is available at any time |
Paid plans | Automatic renewal, 30 days' notice for price increases, 14-day refund window if no usage |
........
Two points stand out. The terms already describe paid subscriptions, App Store purchases and "unlimited" plans subject to reasonable use limits, which indicates that ElevenLabs intends to sell ElevenAI beyond the free beta, even though no paid plan has been announced. The terms also place the full legal burden of recording consent on the user, a heavier obligation in US states that require all-party consent for recorded calls and in the EU, where meeting audio is personal data.
··········
ELEVENAGENTS MEMORY, ROUTINES AND THE INTERACTION ENGINE.
For developers and companies already running voice agents, the agent features carry more weight than the new app. ElevenLabs says Memory will let an ElevenAgents agent build a record of returning, authenticated customers over time. The agent distills each conversation into a structured record that captures details which never had a field in the CRM, such as preferences, constraints and upcoming occasions, while the CRM remains the primary customer record.
The change is significant because, in its own documentation published in September, ElevenLabs states that voice agents do not have built-in memory across calls. Today, continuity between calls depends on dynamic variables that load CRM data at the start of a call, a conversation-initiation webhook and post-call webhooks that write outcomes back to the CRM. Memory would move part of that work into the platform itself for authenticated callers.
Routines is described as a new automation layer that runs multi-step work before, during and after a conversation and connects to existing tools. ElevenLabs gave examples that include pre-screening mortgage applicants, sending patient visit reminders, filling waitlist slots, emailing reports, updating CRMs and starting outbound calls. Both Memory and Routines were announced in the future tense, with no launch date, plan availability or pricing.
The Interaction Engine was previewed as the system that manages the rhythm of a conversation, deciding when the agent should speak and when it should stop after an interruption. It also selects the language model for each part of a conversation, using a cheaper model for triage and a frontier model for complex tasks. ElevenLabs did not disclose which models it routes between, how the routing affects per-minute agent pricing, or when the engine will leave preview.
··········
[[ADPLUS_300x250_1]]
FINE-TUNING AND SCRIBE V3 MEDICAL FOR ELEVENLABS ENTERPRISE CUSTOMERS.
CEO and co-founder Mati Staniszewski announced that ElevenLabs will help businesses fine-tune certain open-source language models and ElevenLabs voice models in the coming months. Customers will be able to train on data from their live deployments, work with ElevenLabs researchers and choose the metrics they want to improve, such as customer satisfaction scores or reliability. Staniszewski compared the offer to each company having its own reinforcement-learning stack. ElevenLabs did not name the open-source models, the minimum contract size or the cost.
Scribe v3 Medical extends the company's domain-specific speech-to-text work to healthcare. ElevenLabs says the model recognizes thousands of complex medical terms and distinguishes similar drug names, giving cycloserine and cyclosporine as an example. The announcement does not state whether Scribe v3 Medical is already available through the API, which languages it supports or what accuracy it achieves on medical benchmarks. A financial services model is also in development, without a date.
··········
ELEVENLABS SUMMIT ANNOUNCEMENTS: AVAILABILITY AND STATUS.
The Summit mixed products that are live with features that were only described. The table separates them according to the status words ElevenLabs used.
........
Announcement | Status | Pricing disclosed |
ElevenAI app | Free early access (beta) | Free during early access |
ElevenLabs Partner Program | Launched | No |
ElevenLabs Marketplace | Launched for discovery | Purchasing planned next year |
Nemotron 3.5 Super VL in ElevenAgents | Available | No |
Interaction Engine | Preview | No |
ElevenAgents Memory | Announced, no date | No |
ElevenAgents Routines | Announced, no date | No |
Fine-tuning of open-source and voice models | Coming months | No |
Scribe v3 Medical | Announced, availability not stated | No |
Financial services speech model | In development | No |
........
For individual professionals, the immediate action is limited to ElevenAI early access, which is free and works first with Google Meet. For companies building agents, nothing in the agent stack changes today except the addition of the NVIDIA Nemotron model; Memory and Routines should be treated as roadmap items until ElevenLabs publishes documentation and pricing. ElevenLabs' other recent model launch, SFX v3 for multi-sound effects, followed the same pattern of shipping first in ElevenCreative and ElevenAPI.
··········
ELEVENLABS PARTNER PROGRAM, MARKETPLACE, MCKINSEY AND NVIDIA.
The Partner Program is aimed at the companies that implement ElevenAgents for large customers. ElevenLabs reports more than 550 active partners in 44 countries, including Google Cloud, IBM, Deloitte, DXC and Genesys, and 1,100 ElevenLabs-certified deployment engineers across 350 partner organizations. The company says partners have produced more than $52 million in partner-sourced and partner-influenced revenue this year and $315 million in partner-generated pipeline. Its stated goal is for partners to earn $3 in services revenue for every $1 of ElevenLabs revenue, and it says its forward-deployed engineers will not compete with partners for implementation work. Program benefits include certifications through a Partner Academy, co-selling and deal registration, partner incentives and a certified partner directory.
The ElevenLabs Marketplace is a curated catalog of industry-specific voice and agent applications built by technology partners, with Salesforce, IBM, NiCE, Twilio and Zendesk named as launch partners. Examples include Zendesk's end-to-end customer service agent, healthcare scheduling and intake tools from Andor Health, Assort Health, Luma Health and PhysiciansTrust AI, and Consio's retail voice and SMS agents, which the company says work in 70 languages. Today the Marketplace supports discovery and direct contact with partners; Staniszewski said enterprises will be able to buy through it with their existing ElevenLabs commitment from next year.
The McKinsey alliance pairs ElevenAgents with the consultancy's transformation practice and QuantumBlack, AI by McKinsey. The expanded NVIDIA partnership adds the Nemotron 3.5 Super VL model to ElevenAgents, 15 MW of new Vera Rubin compute capacity for ElevenLabs, and a joint project to build an on-premises voice agent for Poland's national e-Health platform that will schedule appointments for patients who only have landlines.
··········
ELEVENAI AND ELEVENAGENTS: CONFIRMED FACTS AND OPEN QUESTIONS.
The confirmed changes are ElevenAI early access at no cost, Google Meet as its main supported meeting app during the beta, terms that exclude customer content from model training, the launch of the Partner Program and Marketplace, and the arrival of Nemotron 3.5 Super VL in ElevenAgents. ElevenAI enters a category that Anthropic is also targeting, since Anthropic's product page lists Claude Meetings as coming soon, a feature that will let users add Claude to a call to take notes and update team documents, as described in our report on Claude Sheets, Whiteboards and Claude Meetings.
The open questions concern price and timing. ElevenLabs has not said what ElevenAI will cost after early access, which platforms beyond Google Meet it will support, or when Memory, Routines, the Interaction Engine and fine-tuning will reach customers. Until those details appear in the ElevenAgents documentation and pricing pages, ElevenAI is the only Summit product that a team can try today, and the agent upgrades remain plans backed by company statements rather than shipped features.
··········
FOLLOW US FOR MORE.
·····
DATA STUDIOS
·····
datastudios.org
