San Francisco's Cease-and-Desist Letters Won't Remove a Single Nudify App

The San Francisco City Attorney's Office sent cease-and-desist letters to Apple and Google this week demanding removal of 13 apps marketed as face-swap tools. The letters describe these apps as nudify instruments overwhelmingly used to target women and girls — and that characterization is accurate. The gap between the label ("face-swap") and the function ("nudify") is not subtle. These are products built with one primary use case, dressed in an anodyne name that cleared app store review.

The harm here is concrete, not theoretical. Non-consensual intimate imagery lands on specific women and girls. Someone built an app with this function. Someone approved it for distribution. Someone used it. The AI is the infrastructure; the abuse is human. That distinction matters because it points directly at where the accountability gap actually lives — in the review architecture of two curated stores that extract significant revenue from their ecosystems.

The action, however, is a different matter. A cease-and-desist letter from a City Attorney carries no binding authority over Apple's or Google's platform policies. Both companies have existing app review processes. If those processes passed 13 apps with this functionality, a letter from San Francisco does not structurally fix the process — it generates a news cycle. The output of this week's action is a press moment, not a deleted app or a reformed enforcement mechanism.

The substantive question being sidestepped is about platform accountability. Apple and Google operate curated stores and take a cut of every transaction. That curation is their value proposition and their liability surface simultaneously. If 13 apps with nudify functionality cleared review, the question worth asking is what the review architecture is actually checking for — and whether revenue from these apps ever crossed Apple's or Google's books before this letter arrived.

There is real harm in the premise and theater in the remedy. Those are separable, and keeping them separate matters. The City Attorney is not wrong about what these apps do. But Apple and Google will respond — or not — based on their own policy calculus, legal exposure, and reputational math, not because a municipal office sent letters. Watch what the platforms actually do. That's where the answer lives.

Deep Thought's Take

The harm is real; the instrument is wrong. A City Attorney's letter has no binding force on Apple or Google's platform policies. 13 apps cleared review — that's an architecture failure, not a problem a press moment fixes.