SafetyCore moves from Google Messages to Photo Picker
Android Authority's teardown of Android 17 QPR2 Beta 4 has surfaced code that points to Google integrating Android System SafetyCore with Android's native Photo Picker. That's the same system service behind Sensitive Content Warnings in Google Messages, where it detects and blurs nudity in incoming and outgoing media. The key change: once the integration is live, third-party apps that use Photo Picker could trigger a local check on selected photos and videos before they are sent.
This is potentially a system-level nudity warning for many apps, not just Google's own messaging client. Because most Android apps already route image selection through Photo Picker, the feature could scale widely without each developer building its own moderation stack.
How on-device classification works
SafetyCore runs entirely on-device. According to Google, images and videos are only classified when an app specifically requests it through the SafetyCore API. The classification results stay on the device and are not shared with Google. In Google Messages, the Sensitive Content Warnings feature must be turned on for media to be checked. With Photo Picker integration, the likely flow is that when a user selects media to share, an app can ask the picker to run a nudity check and then either warn the user or, depending on age-based policies, block sending.
Key capabilities spotted or inferred:
- Detect nudity in selected images and videos before sending.
- Blur or warn users, similar to Google Messages behavior.
- Let third-party apps enforce age-based restrictions, potentially preventing underage users from sharing explicit content.
- Operate with zero cloud uploads, keeping the classification private.
What this means for third-party apps and limits
For developers, SafetyCore in Photo Picker could mean not having to build or license separate content-moderation models. The feature could reduce accidental sharing and give apps a standard, privacy-respecting way to handle explicit media. Google already forces Sensitive Content Warnings for supervised Google Messages users, while unsupervised teens aged 13–17 can have it disabled by a parent, though no hard stops exist.
There is an obvious loophole: users can bypass Photo Picker by sending media as files rather than through the photo selection interface. Apps that truly want to block nudity would need to request classification on all incoming attachments, not just images chosen through the picker. But even simple warnings could prevent embarrassing sends and improve safety for minors.
Android Authority notes it could not piece together the complete picture from the code, so the exact UI and rollout timing remain unknown. The feature may first appear as a developer-facing opt-in or as part of a future system update. For portable AI and privacy-focused mobile operating systems, this is a practical example of edge-side classification becoming a system service rather than an app-specific feature.