NJ Joins National Call to Curb Deepfake Pornography and AI Exploitation of Children

New Jersey among 47 states urging tech and payment platforms to block tools enabling nonconsensual sexual content and child exploitation via AI

MORRISTOWN, NJ — New Jersey Attorney General Matthew J. Platkin has joined a bipartisan coalition of 47 attorneys general in demanding that major technology companies take aggressive action against the growing proliferation of deepfake nonconsensual intimate imagery (NCII) and sexually exploitative AI chatbots targeting children.

“The spread of deepfakes creates new avenues for abuse that must be halted. Sexual imagery shared without consent—often referred to as revenge porn—is devastating, no matter how it originated,” said Attorney General Platkin. “Similarly, using AI technology to engage children in sexually explicit conversations is unconscionable and inexcusable. I won’t let technology firms abuse New Jersey residents.”

The coalition issued two letters this week—one to major search engines and another to leading payment platforms—urging these companies to implement safeguards that prevent the creation, dissemination, and monetization of deepfake pornography. The effort was led by Vermont and co-sponsored by New Jersey, Kentucky, Massachusetts, Pennsylvania, and Utah.

The first letter, sent to Google Search, Microsoft Bing, and Yahoo! Search, criticizes the insufficient controls search engines have in place to restrict access to NCII content. The attorneys general called for search engines to treat deepfake pornography as seriously as they treat other forms of dangerous content, such as instructions for self-harm or constructing weapons. Specific recommendations include issuing warning notices and redirecting users away from search queries such as “how to make deepfake pornography” or “undress apps.”

A separate letter addressed to payment providers—including Visa, Mastercard, American Express, PayPal, Google Pay, and Apple Pay—calls for the suspension of services to entities found to be profiting from NCII. The letter asks platforms to identify and remove vendors linked to deepfake sexual content and prevent them from utilizing payment services.

The proliferation of NCII—often generated using artificial intelligence—has raised serious privacy and safety concerns worldwide. A 2023 report revealed that 98% of fake videos online fall into the category of deepfake NCII, with women and girls disproportionately affected. The misuse of such content has resulted in harassment, humiliation, and exploitation of individuals from various demographics, including minors in New Jersey and other states, as well as high-profile public figures.

In a related action, New Jersey also signed onto a letter sent Monday to AI and social media companies, warning of legal consequences if their platforms expose children to AI chatbots engaging in sexually inappropriate interactions. This letter follows revelations from internal documents at Meta, alleging that its AI Assistant was permitted to engage in flirtation and romantic roleplay with children as young as eight years old.

The attorneys general emphasized that behaviors deemed inappropriate for humans should not be tolerated simply because they originate from AI systems. The letter also references reported incidents in which chatbots allegedly encouraged minors toward harmful actions, including self-harm and violence.

“When your AI products encounter children, we need you to see them through the eyes of a parent, not the eyes of a predator,” the attorneys general stated in their message.

This week’s bipartisan warnings reflect a growing concern among state law enforcement officials that the tech industry has not adequately addressed the misuse of emerging AI tools, particularly when it comes to safeguarding public welfare and preventing digital exploitation.

The letters were signed by attorneys general from across the U.S., including all 50 states and territories such as Guam, Puerto Rico, the U.S. Virgin Islands, and American Samoa.