Meta Rolls Out Neural Handwriting, Live Captions, Display Recording and Developer Tools for Ray-Ban Smart Glasses in Its Biggest Software Push Yet

One of the headline features in this update is the expansion of neural handwriting, a capability that allows wearers to compose text through gestural input powered by the Neural Band. Previously limited in scope, neural handwriting now works across Instagram, WhatsApp, Messenger, and native messaging applications on both Android and iOS. This is a meaningful leap in usability. The ability to type within apps that users already rely on for daily communication removes a significant friction point that can hold back adoption of any new input paradigm.

Neural handwriting is driven by the Neural Band, Meta's gesture and neural interaction system built into the glasses hardware. The company has described this control method as central to making the glasses feel seamless rather than effortful. When a user can respond to a WhatsApp message or reply to an Instagram DM without pulling out their phone, the value proposition of wearing a pair of AI glasses becomes considerably more tangible. The expansion to mainstream messaging apps rather than only proprietary Meta surfaces shows the company understands that utility must live where users already spend their attention.

Another new capability arriving with this update is display recording. This feature captures what is happening on the in-lens display alongside the wearer's field of view and audio, combining them into a single shareable video. The result is a first-person format that shows both what the user is seeing in the world and what information the glasses are surfacing in real time.

The potential applications here extend well beyond personal use. Content creators, reviewers, educators, and developers all stand to benefit from a native way to demonstrate how the glasses work in practice. Until now, showcasing the in-lens display experience required external setup or workarounds. Display recording eliminates that barrier and gives users a built-in tool to document and communicate their experience with the device. It also serves Meta's own interests, as user-generated content showing the glasses in action tends to be far more compelling to prospective buyers than any polished advertisement.

The update also introduces live captions, a feature with real accessibility weight behind it. Live captions will transcribe speech in real time, covering both in-person conversations when someone is speaking directly to the wearer, and voice calls conducted through WhatsApp, Facebook Messenger, and Instagram Direct. The transcribed text appears within the in-lens display so the wearer can follow along without needing to look at a phone screen.

For users with hearing difficulties, this feature alone could make the Meta Ray-Ban Display a genuinely assistive device rather than simply a convenience tool. More broadly, live captions serve anyone navigating loud environments, attending calls in settings where audio quality is poor, or simply wanting a record of what was said. The fact that it works across three separate calling platforms from day one, rather than being limited to a single app, suggests Meta put real effort into ensuring the feature is practically useful rather than technically demonstrating what is possible.

Meta has also significantly widened the reach of its walking directions feature. The capability, which delivers turn-by-turn navigation guidance through the glasses display rather than requiring the user to stare at a phone map, is now available across the entire United States. Beyond domestic coverage, the update adds support for major international cities including London, Paris, and Rome.

Navigation is one of those features where the hands-free experience of smart glasses genuinely beats the smartphone in practical terms. Checking your phone for directions while walking is disruptive, and using earphones for audio directions blocks environmental awareness. Receiving a directional cue through a small visual prompt in the corner of your vision, by contrast, keeps both hands free and both eyes on the environment. Expanding this capability to more of the world is a straightforward quality of life improvement that will be noticed immediately by travelers and commuters alike.

Looking ahead, Meta announced that an AI model called Muse Spark will arrive on the glasses this summer. The company described Muse Spark as a first step toward what it calls personal superintelligence, and positioned it as part of a broader family of AI models designed specifically for Meta hardware and products. Details at this stage are limited, but the framing of personal superintelligence, whether taken literally or as strategic positioning, reflects the ambition that underlies Meta's entire wearable computing effort.

The glasses have from their earliest version been built around the idea that ambient AI, intelligence that lives in the environment rather than requiring deliberate interaction through a screen, could transform daily life in ways that smartphones have not. Muse Spark appears to be Meta's attempt to give that vision a specific, named identity on the hardware.

Perhaps the most strategically significant announcement in this update is the launch of a developer preview program for the Meta Ray-Ban Display. For the first time, third-party developers can build standalone web applications for the glasses using standard HTML, CSS, and JavaScript through a new Web Apps framework. Developers can deploy their experiences directly to the glasses via a URL, which is about as low a barrier to entry as a hardware developer program can reasonably offer.

The range of possible applications Meta cited to illustrate the opportunity is deliberately broad: games, public transit tools, cooking guides, grocery list managers, and music practice tools all made the list. This variety signals that Meta is not trying to define a single use case for developer-built experiences. It is instead leaving the door open and betting on the developer community to discover what the glasses are most useful for in practice.

Alongside the Web Apps framework, Meta introduced a Wearables Device Access Toolkit that allows developers to extend their existing mobile applications to the glasses interface. This toolkit adds support for UI elements including text, images, buttons, lists, and video playback, giving developers a practical bridge between their current app investments and the new glasses platform.

The decision to build the developer framework on web standards is significant. HTML, CSS, and JavaScript are the most widely known development tools in the world. By meeting developers where they already are technically, rather than requiring them to learn a proprietary SDK from scratch, Meta dramatically lowers the effort required to start experimenting on the platform.

Meta noted in its announcement that early usage data shows users are increasingly engaging with AI-powered visual responses and the display features of the glasses. The company also pointed to strong user feedback around the Neural Band input system, reinforcing that gesture and neural controls are landing well with people who use them regularly. Demand for the product has remained strong enough that Meta said it is continuing to work on fulfilling orders and maintaining retail inventory, which suggests supply has been a constraint rather than consumer interest.

What this update collectively represents is a company that has moved past the proof-of-concept stage with its smart glasses and is now executing on a longer-term product roadmap with confidence. The additions are not incremental. Neural handwriting across major messaging platforms, live captions for accessibility and call support, display recording for content creation and documentation, genuinely wide navigation coverage, and a developer program that lowers the barrier to building for the glasses all at once constitute a statement of intent about where Meta believes this product category is heading.

Whether smart glasses ultimately find mass adoption in the way smartphones did is a question no single update can answer. But with this release, Meta has made a compelling case that the Ray-Ban Display is becoming something more than a novelty, something that competes on genuine usefulness and invites a developer community to help define what wearable computing actually means in daily life.