San Francisco Attorney Demands Removal of "Nudify" Applications from App Stores

San Francisco City Attorney David Chiu has formally called upon technology leaders Apple and Google to eliminate "nudify" applications from their respective app stores. The request highlights concerns about content generation that could potentially exploit individuals, particularly minors. According to TechCrunch, letters were dispatched by Chiu's office to both corporations, stating that they have long been aware that such applications hosted on their platforms contravene existing state legislation. The city attorney’s office emphasized the serious implications of these apps, which can create non-consensual deepfake imagery, often depicting individuals in nude or sexually explicit contexts. The communication from San Francisco specifies that these "nudify" tools utilize artificial intelligence to generate synthetic images. Such technology allows users to upload photographs of individuals, who are then digitally altered to appear unclothed without their permission. This process raises significant ethical questions and legal issues regarding privacy and consent. Chiu's office asserts that the distribution of these applications through major digital storefronts facilitates the creation and potential dissemination of harmful content. The city attorney underscored the necessity for platforms to uphold their responsibility in preventing the proliferation of tools that enable non-consensual intimate imagery. The focus remains on protecting individuals from digital exploitation and ensuring digital safety. Legal experts note that California has laws in place designed to combat the creation and distribution of deepfake pornography and other forms of non-consensual imagery. The city attorney's initiative seeks to enforce these existing protections by targeting the distribution channels for applications that enable such activities. This action is part of a broader effort to address the evolving challenges posed by advanced AI technologies in the digital space. Both Apple and Google maintain strict guidelines for content permitted on their app stores, prohibiting sexually explicit material and content that promotes illegal activities. The San Francisco City Attorney's recent letters pressure these companies to rigorously apply these policies to "nudify" apps, reinforcing the commitment to user safety and compliance with state law.