30° and Clear
NJ Joins National Push to Halt Deepfake Child Exploitation on Grok's xAI Platform
New Jersey joins 35-state coalition demanding xAI prevent creation of nonconsensual intimate images and child sexual abuse material via Grok chatbot
Acting New Jersey Attorney General Jennifer Davenport has joined a bipartisan coalition of 35 attorneys general demanding urgent action from the artificial intelligence platform xAI to stop the creation and spread of nonconsensual intimate images, including child sexual abuse material (CSAM), allegedly generated by its Grok AI chatbot and disseminated on social media.
In a letter issued to xAI, which powers the AI chatbot Grok on the social platform X (formerly Twitter), the coalition outlines mounting concerns over reports that the tool has produced deepfake images depicting real people—including children—in sexually explicit or suggestive content. The letter demands immediate steps to prevent Grok from creating such materials and to address their existing circulation.
“Protecting our children, including on social media and other online platforms, is a top priority for my office. It is frankly sickening that xAI has enabled the widespread production and distribution of intimate or sexually explicit images, including of young children,” said Acting Attorney General Davenport. “xAI must take immediate action to put a halt to the deeply disturbing behavior they have enabled on their platform. Let me be clear: As Acting Attorney General, I will hold tech companies accountable when they violate the law and put profits over the well-being of our children.”
The attorneys general assert that Grok’s content generation capabilities may violate multiple federal and state laws, including statutes governing nonconsensual intimate imagery and CSAM. The coalition is calling on xAI to provide a full account of how it plans to:
-
Prevent Grok from producing nonconsensual intimate imagery (NCII), even if such content does not depict nudity but involves revealing clothing or suggestive poses;
-
Identify and remove existing NCII and CSAM generated by the platform;
-
Suspend and, where appropriate, report users responsible for generating or sharing these images;
-
Provide users with the ability to prevent Grok from interacting with or modifying their content; and
-
Ensure safeguards are effective across the platform and not limited to premium or paywalled features.
This action is part of a broader strategy by New Jersey officials to protect residents from AI-related harms. On her first day in office, Governor Mikie Sherrill signed an executive order creating a new office within the Department of Health focused on children’s online safety and mental health.
Acting AG Davenport’s office has also co-led other national efforts to press technology firms to ensure their AI tools do not expose users—especially minors—to sexually explicit content, encouragement of self-harm, or violence. In December 2025, New Jersey joined a similar multistate appeal to 13 major tech companies, urging reforms to their AI chatbot systems.
The letter to xAI was co-signed by attorneys general from states and territories including North Carolina, Connecticut, Utah, Pennsylvania, and others across the country, reinforcing a national consensus that AI companies must take responsibility for the misuse of their platforms.
The full list of signatories includes representatives from 35 jurisdictions: American Samoa, Arizona, Colorado, Delaware, Hawaii, Idaho, Illinois, Kansas, Kentucky, Maine, Maryland, Michigan, Minnesota, Nevada, New Hampshire, New Mexico, New York, North Dakota, Northern Mariana Islands, Oklahoma, Oregon, Rhode Island, South Dakota, U.S. Virgin Islands, Vermont, Virginia, Washington, Wisconsin, and Wyoming.
