Meta’s new devices show us what our future could look like

In introducing Meta’s latest products at its Connect conference on Thursday, Mark Zuckerberg described a future in which many of the objects and people in our homes are holograms – digital representations rather than physically present flesh or media – and AI agents have access to what you see and hear. It’s not an especially comfy thought, but it’s also not illogical or unlikely.

Almost all popular media is already digitised, from ebooks to streaming music and movies to calendars and notepads. The mixed reality concept merely moves them off our portable devices, computers or TVs and puts them somewhere to access at any time, and we may choose to have them represented in our homes as icons we can interact with.

Mark Zuckerberg introduces the Meta Quest 3 at Connect in California.

Our relationship with many friends and family members is largely digital, too, so instead of cynically assuming the future will replace face-to-face meetings with holograms, we can instead imagine there will be a warmer or more pleasant way to keep in touch with absent loved ones than typing WhatsApp messages on our phones. For example, maybe a photo of your mother on the wall will update with a new video message.

However, even given a generous interpretation of the fantasy, it remains a fantasy, and the technology to realise it doesn’t exist yet. But after playing around briefly with the new devices, I have a bit of a clearer idea of where Meta’s going with it.

Skip the phone and use your face

To get the obvious out of the way first when it comes to the company’s new smart glasses, I know many people react in horror any time there are cameras and microphones on a device that doesn’t traditionally have them. But in this case, I don’t think there are additional privacy concerns over any combination of smartphone and earbuds.

The glasses are heavier and have stiffer arms than regular glasses, but are presumably also a lot more durable because of the tech that has to run along each side and through the hinges. They look as good as regular Ray-Bans, and there’s no special tech in the lenses, so you can have them fitted with whatever you like.

The Ray-Ban Meta smart glasses have a white light that flashes any time the camera is on, which is really something phones should have too.

Above each ear is a speaker, and they work just like earbuds. When connected to your phone via Bluetooth, the audio from music, podcasts or calls fires down into your ears, and sounds very decent. Your ears are still open so the speakers aren’t great for noisy areas, but they also don’t leak much so you won’t bother others nearby with your music. A touch panel on the right arm has playback controls.

You can press a button at your temple to take a photo, or hold to start a video (both are portrait orientation only), which can sync to your phone. The camera is on the left side, so it took me a few shots to get a handle on framing. On the right side is a very noticeable light that flashes any time the camera is getting power. It also disables the camera if it is covered or tampered with. From what I’ve seen so far, it would be more difficult to film someone secretly with these glasses than it is with a phone.

The Meta Quest 3 is much smaller than the Quest 2, but still designed for gaming.

The idea is that quickly touching your glasses lets you record moments without putting a phone between you and the moment itself, with the trade-off that the images probably aren’t quite as good or composed. That said, the pictures are bright and detailed, and I was impressed when watching a video that the glasses recorded a very convincing stereo mix from its five microphones.

If you start a livestream on Facebook or Instagram with your phone, you can switch to the glasses at any time to show your viewers your own point of view, which worked well when I tried it and is definitely preferable to strapping a GoPro to your forehead.

A future update will add Meta AI to the glasses; you speak to it out loud and it answers in your ear. You could ask it to take a photo and send it to a friend for example, and it will do it with no phone touching required. A further update will let the AI access the cameras and microphones when you ask for it, for example to identify songs, translate signs or tell you what a particular landmark is. This is again something we already use our phones for, and could be much quicker here if it works, though I didn’t get to try it out.

Your home as a VR gaming backdrop

The obvious long-term goal is to have tech in the glasses that can project digital objects into your view, but getting the lenses, processing and battery required into a device that small requires a few leaps yet. The closest Meta has is the new Quest 3 VR headset.

My first impression was that it is noticeably smaller than the Quest 2. It’s also lighter, with no pressure on your nose or forehead even with the standard included strap, and it can quickly be adjusted to add some extra space if you (like me) are short-sighted and want to wear glasses in VR. It also has a higher resolution and a wider field of view, which in practice means I didn’t have to spend a few minutes adjusting it on my face to get a good fit and a clear view; it was sharp immediately.

Starting next year, Meta Quest users will be able to place “augments”, or digital items, in their real world homes.

But the best new feature is the Passthrough; with the goggles on, the room was still clear and in great colour, and nothing was warped or jittering as tends to happen on the monochrome Quest 2 and PlayStation VR 2. You also get less of that weird feeling that your eyes are too far from your body. I was able to talk normally to the Meta demo person, and could even check my phone and watch without taking the headset off.

The Quest 3 scanned and mapped the room, so it’s easy to imagine a future in which you could whack a virtual poster on the wall that plays a particular playlist when you activate it, or even just a massive virtual screen for movies. In my demo, I played a game where the walls crack open to reveal a world of fuzzy little ball creatures, that you need to shoot as they try to invade your space.

Moving around in VR usually makes me pretty motion sick (I later played the new Assassin’s Creed game on the Quest 3 and when my character fell off a roof I was pretty much done), but making the real-world space the backdrop eliminated that feeling. That said, if you are in a completely immersive app with no view of the outside, the same scanning tech that maps the walls, floors and ceilings will let you know if you get too close by making them temporarily visible.

So how does the Quest 3 compare with Apple’s Vision Pro, considering it’s a sixth of the price? Obviously we won’t know until they’re both available, but you can tell by the specifications that the companies are targeting different experiences. Both want to impose digital graphics on the real world for a new generation of entertainment and productivity apps, but Apple is including eye tracking, face tracking, automatic pupil distance adjustment and a massively higher quality display (at least on paper), indicating a focus on creative professionals and consumers at the ultra-premium end of the market, where Meta’s device is mass market and primarily for games.

A step towards a distant future

The reality of using glasses rather than a phone or computer to access your digital life is still quite far away, but we’re beginning to see how it could happen.

Nobody is going to wear a Quest 3 around the house purely so they can access their ebooks without grabbing their Kindle. It’s not comfortable enough, the screens aren’t good enough, and the tech isn’t even there yet. Meta’s first digital household objects (or “augments”) are coming in a future update.

Meanwhile, the smart glasses are limited in their ability to replace your phone’s screen without a screen of their own. But it’s clear the two devices are working towards the same solution from different directions.

The author travelled to California as a guest of Meta.

Get news and reviews on technology, gadgets and gaming in our Technology newsletter every Friday. Sign up here.