Ofcom has launched an investigation into X over claims its Grok AI chatbot is generating sexual deepfakes.
The UK regulator said there had been reports of the tool being used to create and share undressed images of people, including children.
“Reports of Grok being used to create and share illegal non-consensual intimate images and child sexual abuse material on X have been deeply concerning,” a spokesperson said.
Ofcom could fine X up to 10% of qualifying worldwide revenue, or up to £18 million, if it is found to have broken the law.
If X fails to comply, Ofcom can seek court orders to block the site in the UK.
X responds
X’s safety account said the platform takes action against illegal content, including child sexual abuse material, by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary.
“Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content,” the statement said.
Tech billionaire Elon Musk later criticised the UK government, claiming it “wants any excuse for censorship.”
We take action against illegal content on X, including Child Sexual Abuse Material (CSAM), by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary.
Anyone using or prompting Grok to make illegal content will suffer the… https://t.co/93kiIBTCYO
— Safety (@Safety) January 4, 2026
UK criminalises deepfake nudes
The UK government has passed a law making it a criminal offence to use artificial intelligence to create non-consensual intimate images.
It also plans to make it illegal for companies to supply tools designed to generate such images.
Technology secretary Liz Kendall said sexually manipulating images of women and children is “despicable and abhorrent.”
“We will be banning nudification apps in the Crime and Policing Bill, which is in parliament now,” she said.
“We are in the coming weeks bringing into force powers to criminalise the creation of intimate images without consent.
“We are as determined to ensure women and girls are safe online as we are to ensure they are safe in the real world. No excuses.”