posted in Technology
Android users can't remove nude-scanning app as Google opens the feature to app developers
cross-posted from : lemmy.zip/post/70348978
cybernews.com/security/android-content-safety-manager-api-privacy-concerns/posted in Technology
Android users can't remove nude-scanning app as Google opens the feature to app developers
cross-posted from : lemmy.zip/post/70348978
cybernews.com/security/android-content-safety-manager-api-privacy-concerns/Reportedly, the app uses an on-device machine learning model to classify the content.
Using your shiny new phone to train AI…
For now its only supposed to check Google Messages, so not if you use a different text app.
But one vulnerability already is side loaded versions with super high version numbers so they won’t be auto updated. Those will scan everything and do whatever with it. Considering the apps point is to scan for nudes, likely sending all your nudes to the hacker.
Reportedly, the app uses an on-device machine learning model to classify the content.
Using your shiny new phone to train AI…
I would think the models are already trained, and then deployed to phones to do on-device inference. The models should be fixed and static by the time they end up on a phone (in large part because phone hardware is just not technically suitable for training, whether pre training or post training).