posted in Technology

New AirPods leak reveals built-in cameras and Visual Intelligence

Rather than functioning as conventional cameras, the sensors are expected to feed information into Visual Intelligence. This would allow Siri to answer questions about what is around the wearer or save information they encounter throughout the day.

This is not the first report suggesting Apple is developing AirPods with cameras. Bloomberg’s Mark Gurman previously claimed the earbuds would collect “visual information in low resolution,” effectively acting as eyes for Apple’s AI features.

Potential uses could include asking Siri questions about nearby objects, saving information without taking out your iPhone, or receiving more detailed turn-by-turn directions based on the wearer’s surroundings.

The AirPods shown in the video resemble a slightly thicker version of the AirPods Pro 3, with longer stems seemingly providing room for the additional hardware.

Apple has not officially announced the device, so its final name, price, features, and launch date remain unknown. However, previous reports suggest the AirPods could arrive as early as September alongside Apple’s next generation of iPhones.

www.dexerto.com/entertainment/new-airpods-leak-reveals-built-in-cameras-and-visual-intelligence-3400062/
enPage

Replying to an earlier post

But like calling the Meta glasses “Pervert Glasses” it’s not about being technically accurate in your description of the scope of surveillance, it’s about making it socially unacceptable. It’s why using “weird” worked so well for Waltz - it didn’t provide an all encompassing description of why Trump and his ilk were dangerous and bad for the country, it just nailed how to shine a light on how they’re socially unacceptable (to rational and sane ppl obvs.)

Replying to an earlier post

It’s frustrating I know, but I truly think it’s less culture and more just hairless ape brain stuff. Our brains are lazy by evolutionary design and in terms of social communication, it’s sadly more effective to aim straight for the emotional limbic system. We should be creatures capable of sustained rational thought, but… <gestures broadly> that obviously isn’t the case and never has been. It’s all much worse when you’re someone not as prone to emotional appeals, but the trick is to appeal to the emotion and then follow it up with a little bit of the objective reality.

Replying to @⁨Assassassin@lemmy.dbzer0.com⁩

Because they have to compete with other tech giants and their AI initiatives or they will be left behind and eventually bought out by one of them. All these companies are in fierce competition with each other for survival right now. You still think they make products for our benefit? Those benefits are necessary for us to participate, it isn’t why they make those products.

Replying to an earlier post

Maybe BS, but I’d wager only partly true, because the kind of sensors needed for basic local environment awareness aren’t “cameras” in the usual sense even if the have an array of photoreceptors like a camera uses. It might be better described as a higher resolution version of the IR light detectors currently used.

Regardless, given a few undeniable technical realities, like ridiculously tiny batteries and the bandwidth requirements of video vs available BT throughput, there is 0% chance of these earbuds becoming pervglasses-like surveillance wear.

Reactionaries and sourgrapists don’t give a rats ass about truth, however, so prepare for sensationalist headlines no matter what.

Replying to an earlier post

Individual photos could be transferred. And most of their recent SOCs can do on-device image interpretation. That’s how their Photos app captions and labels pictures. It’d probably work OK for large objects even at low fidelity So I think that’s possible.

Still not really sure how they would capture video. At nearly any resolution it would heavily tax the grain of rice size battery, on top of the processing power needed for encoding a video stream, and that’s assuming their new chip includes P2P WiFi capability to solve the bandwidth issue.

What I expected they might try was passive spatial mesh construction using either SLAM or LiDAR to integrate with their spatial computing and accessibility or indoor navigation. But if all it’s doing is describing what can be captured in a photo, that sounds plausible.

Replying to an earlier post

At this point, it seems like the only way out of this situation is the weaponization of EMPs. I’m not supporting that, I’d personally prefer if medical technology and refrigerators and similar things still worked, but if people don’t like cameras everywhere (and we can now very clearly see that they don’t) and companies insist on putting cameras into all types of technologies where they’re not always visible, where else could this lead?

Replying to an earlier post

It won’t. Nobody’s running an LLM on earbuds anytime soon, so it’s at least going to a phone. From þe phone, it’s almost certainly going to þe cloud since Siri AI makes cloud requests to Apple’s infrastructure for exactly þe kind of prompts TA suggests:

It takes full advantage of the bold new architecture for Apple Intelligence, including the next generation of Apple Foundation Models that run on device and on servers using Private Cloud Compute.

Þey put “private” in þe name so you know you can trust it 🙄

Replying to an earlier post

Er, visual intelligence isn’t an LLM. It processes the image to determine what is being looked at, including text and attempts at context.

Also, the fact that it’s going to the phone is a given, meaning it’s a feature that would be tied to a specific generation of phone or newer.

It could go so far as to require the generation released with it, which could absolutely have the models on device.

That said, all of this, on both sides, is speculation. There’s no guarantee it’s even getting cameras.

Replying to @⁨KairuByte@lemmy.dbzer0.com⁩

There is no reason to assume it will be able to record

If you know how either a camera or an LLM works, you sure the fuck do have reason to assume that.

Visual Intelligence isn’t an LLM

Just because Apple uses a bunch of stupid fucking corpo buzzwords that say Visual Intelligence isn’t an LLM (they call it an “AFM” which just stands for “Apple Foundational Model”) doesn’t make it true. It’s an LLM; just a proprietary model Apple has made. It’s machine learning “AI.”

Replying to an earlier post

Eh? An LLM is a large language model. A language model would have no way to analyze an image. No matter the name assigned to it, it is literally impossible for it to be an LLM.

If you are misusing LLM to mean machine learning model, then… I mean stop using LLM because it’s just plainly incorrect.

There’s also the fact that current generation visual intelligence is image only. It doesn’t support video. Which makes a lot of sense, because streaming out high definition video would be quite the bandwidth requirement, and doing that constantly while someone is wearing AirPods would be insane.

The idea that cameras inherently imply recording is also kinda silly. Eye tracking in VR headsets use cameras, I promise that unless you do some hijinks those camera feeds are not recorded. Just like the camera on my robot vacuum, or the rear view camera on my car. All video recording requires cameras, but not all cameras require video recording.

Replying to @⁨KairuByte@lemmy.dbzer0.com⁩

They have to record to process the data. The recording may be limited to just living in the active memory, but it still records something in all those cases. The vaccuums even phone that data home; the most popular ones have been hacked numerous times, including one that let the hacker see other people’s robot vacuum camera feeds live.

Replying to an earlier post

Recording inherently means saving. The exact definition includes the word “permanent”. Arguing that recording in this case means “the image data exists in memory” is a level of semantics that means literally nothing in this argument. Yes, we are all quite aware that the image data exists in one form or another when the camera is on. The question is, is it creating a recording, streaming that out, or handling the data locally and disposing of the data before it reaches permanent storage.