Discord has acknowledged {that a} bug in its AI moderation system mistakenly banned greater than 8,000 customers over the previous two months, after innocent photographs—together with spreadsheets, chessboards, sport textures, in addition to white and grey clear backgrounds—have been incorrectly flagged as dangerous content material.
The corporate confirmed that the problem had been affecting accounts since Could, with an extra 200 customers banned over the weekend earlier than its workforce recognized and stuck the issue. All affected accounts are presently within the means of being restored.
The incident highlights one of many rising challenges surrounding AI-assisted moderation as many platforms more and more depend on automated programs to determine unlawful or abusive materials at scale.
In a detailed thread on X, Discord defined that its automated security system works by matching uploaded content material in opposition to databases of identified dangerous materials. Whereas the know-how is designed to catch unlawful content material, the corporate acknowledged that it could actually generally generate false positives. A human moderator evaluations the content material, however a bug prompted the system to right away ban affected accounts.
“We’re engaged on higher safeguards so this may’t occur once more,” the corporate wrote.
Our programs flag content material by matching it in opposition to identified dangerous materials. This sort of similarity matching can produce false positives, which is why a member of our Belief & Security workforce all the time evaluations flagged content material earlier than any motion is taken.
The supposed conduct is to…
— Discord Assist (@discord_support) July 7, 2026
Throughout X and Reddit, customers have claimed they’d been completely suspended merely for importing photographs containing sq. grid patterns. A number of customers speculated that Discord’s AI moderation instruments have grow to be more and more delicate to grid-like patterns as a result of they’ve beforehand been utilized in makes an attempt to obscure or disguise NSFW and baby exploitation content material from automated detection programs.
Affected customers have been expressing frustration on social media, with some arguing that everlasting account bans primarily based solely on automated detection can have severe penalties, significantly for customers who depend on Discord for work, gaming communities, or long-distance social connections.
“Shedding a Discord account to one thing as unfair as this may be extraordinarily devastating and have an effect on customers severely, and day-after-day tens of millions of customers are affected by false AI bans. This must be stopped,” one X person wrote.
My account was wrongfully banned out of your platform attributable to a bug in your AI automod detecting my GAME TEXTURES as CSAM. I would like my account again as I’m a sport director and use Discord for all my communication. I’ve requested a evaluate of my suspension.@discord @discord_support pic.twitter.com/QfAkCIJo6S
— JDBRYANT 🎂 TODAY (@jdbryantdev) July 4, 2026
Discord isn’t alone in going through moderation troubles attributable to automated programs. Final yr, customers of Instagram and Facebook Groups reported widespread unexplained account suspensions that many believed have been brought on by AI moderation programs. Though customers pointed to automation because the doubtless perpetrator, Meta by no means publicly confirmed whether or not AI errors have been accountable. Now Meta’s Oversight Board is pushing for increased transparency.
Tumblr final yr additionally faced complaints from customers who stated their accounts had been mass-suspended with out clear explanations.
Whenever you buy by hyperlinks in our articles, we may earn a small commission. This doesn’t have an effect on our editorial independence.
