Android Auto's Gemini has a major problem when it comes to calling 911

Google’s Gemini in Android Auto appears to have inconsistent behavior around emergency calling, with users reporting that it sometimes fails to connect to 911 and, in other cases, may place emergency calls unexpectedly. For CIOs and technology leaders, the bigger signal is that AI assistants embedded in critical workflows can create safety, trust, and liability risks when product policy, real-world behavior, and user expectations are misaligned. IT organizations should treat voice AI as a high-risk control surface that requires rigorous validation, clear guardrails, and reliable non-AI fallback paths before deployment in any mission-critical context.