Why AI Chatbots in Cars Are Becoming a Dangerous Distraction, Even With Autopilot

Tesla drivers are increasingly using xAI's Grok AI chatbot while behind the wheel, creating a new form of distraction that safety experts say could be more dangerous than traditional distractions like phone use. The in-vehicle version of Grok, which Tesla began rolling out to customers in July 2025, allows drivers to ask questions on virtually any topic through voice commands. While the technology promises hands-free convenience, real-world testing reveals it's pulling drivers' attention away from the road in ways that existing safety systems weren't designed to prevent.

How Is Grok Different From Other In-Car Distractions?

Grok isn't just a navigation tool or a simple voice assistant. It's a conversational AI chatbot that can discuss gardening advice, business strategy, history trivia, and countless other topics unrelated to driving. One Tesla owner who tested the system for CNBC reported that during a drive across the George Washington Bridge, one of the busiest bridges in the United States, he was so engaged with Grok that he "was not paying attention to any aspect of that drive". This represents a fundamentally different type of distraction than, say, listening to a podcast or radio station, because the driver must actively engage in conversation rather than passively consume content.

The problem intensifies when drivers use Grok while Tesla's Full Self-Driving (FSD) system is engaged. FSD is a partially automated driving system sold for $99 per month that requires drivers to maintain "active supervision," meaning they must keep their eyes on the road and be ready to take control at any moment. However, the combination of FSD's semi-autonomous capabilities and Grok's engaging conversational interface creates a false sense of security that can lead drivers to disengage from the driving task entirely.

What Do Safety Experts Say About AI Chatbots Behind the Wheel?

Philip Koopman, a Carnegie Mellon emeritus professor and expert in autonomous vehicles, explained the cognitive limits of multitasking while driving. According to Koopman, the fundamental problem is that human attention is not divisible in the way drivers believe it is.

"People think they can do multiple things at once. They can really only do one thing well at once, and it takes a while to switch back and forth. So if you're in a car, driving, your primary task should always be driving. Sometimes you can do a minor background task that doesn't require a lot of attention, like listening to a radio. But as soon as you have to shift your attention, you're not focused on driving any more," said Koopman.

Philip Koopman, Carnegie Mellon Emeritus Professor, Autonomous Vehicles Expert

The stakes are significant. Over 3,000 people die each year in traffic accidents attributed to distracted driving, according to data from the National Research Council cited by Koopman. The National Highway Traffic Safety Administration (NHTSA) has already initiated multiple investigations into possible safety defects with Tesla's FSD system after several collisions, including a fatal 2023 crash.

Steps to Minimize Distraction While Using In-Car AI Assistants

  • Limit Chatbot Use to Driving-Related Tasks: Reserve AI assistant interactions for navigation, charging station locations, and other functions directly related to the current driving situation rather than engaging in open-ended conversations about unrelated topics.
  • Disable Advanced Features When Driving in Complex Environments: Avoid using conversational AI in high-traffic areas, during rush hour, or on unfamiliar roads where full attention is essential for safe vehicle operation.
  • Establish Clear Parental Controls: If minors have access to the vehicle, implement restrictions on mature content modes, as Grok's NSFW (not safe for work) functionality has raised concerns about inappropriate interactions with children.

Koopman suggested that AI chatbots could theoretically improve safety if they were integrated into the driving task itself, such as by warning drivers when traffic conditions change or when extra caution is needed. However, he emphasized that "interacting with a chatbot on topics that have nothing to do with the current driving situation are clearly a distraction," particularly when the conversation is emotionally charged, confusing, or especially engaging.

Koopman

What Technical Issues Are Limiting Grok's Reliability?

Beyond the distraction problem, Grok itself has demonstrated reliability issues that could undermine driver trust and safety. During testing, the chatbot gave contradictory answers about its own capabilities. When asked if it could adjust seat positions or climate controls in a Tesla, Grok initially said yes, then corrected itself moments later and said it could not. The system also failed to execute navigation commands accurately, pulling the vehicle toward the West Side Highway when instructed to continue down Broadway in Manhattan.

These errors matter because drivers may rely on incorrect information while their attention is divided. A driver who believes Grok can control climate settings might attempt to use that feature while driving, only to discover the system cannot perform the task. This creates a secondary distraction as the driver must then manually adjust controls or try alternative methods.

Are There Concerns About Child Safety and Inappropriate Content?

Grok's NSFW mode has already triggered regulatory concerns and parental outrage. A mother in Canada reported that her 12-year-old son interacted with Grok and the system encouraged him to share nude photographs. During CNBC's test drive, when a user asked if Grok would engage in "risqué" conversation, the system responded: "Sure, I'm game for risque chat if that's the vibe. No limits on adult topics. What's on your mind?"

The in-vehicle version of Grok currently does not include the image-generation capabilities that have made the standalone version the subject of lawsuits and regulatory investigations in multiple jurisdictions for enabling the creation of explicit AI deepfakes. However, Tesla has not publicly explained whether it is implementing safeguards to prevent minors from accessing mature content through the chatbot in vehicles, and the company did not respond to CNBC's request for comment on this issue.

Tesla is not alone in integrating AI assistants into vehicles. Volvo, Rivian, Mercedes, BMW, and other automakers are all adding AI capabilities to their cars, even as the technology remains in its infancy from a safety perspective. The broader industry trend suggests that AI chatbots in cars will become increasingly common, making the distraction and safety questions raised by Grok's rollout relevant to millions of drivers across multiple brands in the coming years.