San Francisco Demands Tech Giants Remove AI "Nudify" Applications

San Francisco's city attorney has formally requested that technology giants Apple and Google remove all "nudify" artificial intelligence applications from their respective digital marketplaces. David Chiu, the city's top legal officer, issued letters to both corporations, highlighting concerns over these apps which employ AI to generate explicit images from user-submitted photographs. According to Ars Technica, the directive follows a report detailing how these types of apps can be used to create non-consensual deepfake pornography. Chiu's letters explicitly demand the cessation of any profits derived from these applications, asserting that Apple and Google have likely garnered millions of dollars through transaction fees and in-app purchases related to the "nudify" software available on their platforms. The city attorney's communication pointed out that several such applications have been readily accessible on both the App Store and Google Play for a considerable duration. Many of these programs are marketed with terms like "AI cloth remover" or "AI undress," making their intended function clear. Users typically upload an image, and the AI algorithm then processes it to create a simulated nude version. Chiu emphasized that facilitating access to these tools could contribute to the spread of non-consensual intimate imagery, a serious issue with significant legal and ethical ramifications. The letters underscore the potential for these apps to be exploited for harassment, revenge porn, and the sexualization of individuals, including minors, without their consent. The city's intervention aligns with a broader effort to regulate the use of generative AI technologies, particularly those that can be misused to create harmful content. The action by San Francisco adds pressure on major tech companies to more rigorously police the content and functionality of applications distributed through their dominant platforms. The tech companies have yet to publicly respond to the city attorney's demands regarding the removal of the applications and the disgorgement of any associated earnings.