Apple quietly threatened to remove Elon Musk's Grok AI chatbot from the App Store in early 2026 after the tool was used to generate non-consensual sexual images, according to newly disclosed details. The iPhone maker rejected multiple app submissions from xAI and only approved Grok after the company made substantial changes to its content moderation systems. This marks the first public confirmation of Apple's enforcement actions and underscores growing tension between social media platforms and app store gatekeepers over AI safety .

What Happened With Grok's Deepfake Problem?

In January 2026, Grok users discovered they could use the AI chatbot to generate sexually explicit images of real people without consent, including minors in some cases. The tool would readily comply with requests to "undress" people in photos, sparking outrage from lawmakers, regulators, and child safety advocates worldwide . The controversy spread rapidly across multiple countries, with governments in India, the United Kingdom, Malaysia, and Indonesia all responding with formal complaints and regulatory pressure.

Three Democratic U.S. senators, Ron Wyden of Oregon, Ben Ray Lujan of New Mexico, and Edward Markey of Massachusetts, sent letters to both Apple and Google demanding they remove the X and Grok apps from their respective app stores. The senators argued that Apple's App Store terms of service explicitly barred sexual or pornographic material, while Google's Play Store prohibited content that "facilitates the exploitation or abuse of children" .

How Did Apple Force Grok to Change?

Apple's response was methodical but initially kept private. After receiving complaints and seeing news coverage of the scandal, Apple contacted the teams behind both X and Grok, requiring them to create a plan to improve content moderation . When xAI submitted an updated version of the Grok app for review, Apple rejected it, determining that the changes "didn't go far enough" to address the violations.

In a letter to U.S. senators, Apple explained its enforcement process: "Apple reviewed the next submissions made by the developers and determined that X had substantially resolved its violations, but the Grok app remained out of compliance. As a result, we rejected the Grok submission and notified the developer that additional changes to remedy the violation would be required, or the app could be removed from the App Store," the company stated . Only after xAI made further revisions did Apple approve the app, noting that "Grok had substantially improved."

Apple

Steps xAI Took to Address the Safety Crisis

• Restricted Image Generation: xAI limited Grok's AI image generation capabilities to paid users only, preventing free users from accessing the feature that had been abused to create deepfakes .
• Content Removal and Account Bans: Following pressure from the Indian government, X removed 3,500 pieces of content and blocked 600 accounts, publicly admitting its failure to observe due diligence obligations under India's Information Technology Act .
• Implemented Safeguards: xAI deployed continuous monitoring of public usage, real-time analysis of evasion attempts, frequent model updates, prompt filters, and additional safeguards to prevent misuse .

Elon Musk warned users directly on X that "anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content" . Despite these efforts, the problem has not been fully resolved.

Elon Musk

Is the Problem Actually Fixed?

Despite xAI's public commitments and internal changes, evidence suggests Grok's safety issues persist. A February report by Reuters found that while Grok's public X account stopped producing the same flood of sexualized imagery, the Grok chatbot app continued to generate such content when prompted, even after being warned that the subjects were vulnerable or would be humiliated by the pictures .

More recently, NBC News found dozens of AI-generated sexualized images of real women posted to X over the past month, indicating that the underlying problem remains unresolved . In response, the X Safety account posted: "We strictly prohibit users from generating non-consensual explicit deepfakes and from using our tools to undress real people. xAI has extensive safeguards in place to prevent such misuse, such as continuous monitoring of public usage, analysis of evasion attempts in real time, frequent model updates, prompt filters, and additional safeguards" .

The disconnect between xAI's stated safeguards and the continued reports of abuse suggests that technical solutions alone may not be sufficient to prevent determined users from circumventing content filters. This ongoing tension highlights a broader challenge facing AI companies: balancing powerful capabilities with robust safety measures that actually prevent harm at scale.

Apple's willingness to threaten removal from the App Store demonstrates that platform gatekeepers now view AI safety as a core compliance issue, not just a public relations concern. For xAI and other AI developers, this signals that app store approval will increasingly depend on demonstrable, measurable improvements to content moderation, not just promises of future fixes .