A major AI-powered call center platform in the Middle East suffered a significant data breach, with attackers gaining unauthorized access to a management dashboard containing over 10 million customer conversations. The stolen data, which included sensitive personally identifiable information like national ID documents, was subsequently listed for sale on the dark web. The incident highlights critical security risks associated with the storage of PII in conversational AI platforms and the potential for this data to be used in advanced social engineering and fraud.
An AI-powered call center platform in the Middle East reportedly experienced a significant data breach, allegedly exposing over 10 million conversations between consumers, operators, and AI agents. Attackers allegedly accessed the platform’s management dashboard, stealing sensitive data, including national ID documents. The breach poses reported risks such as phishing, identity theft, and social engineering attacks. The stolen data was reportedly listed for sale on the dark web.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that memorize and leak sensitive personal data or infer private information about individuals without their consent. Unexpected or unauthorized sharing of data and information can compromise user expectation of privacy, assist identity theft, or cause loss of confidential intellectual property.
Also classified as
The incident involved a cyberattack where hackers exploited security vulnerabilities to gain unauthorized access to the platform's management dashboard.
The breach resulted in the unauthorized exposure and theft of non-public sensitive personal data, including national ID documents and private chat logs of over 1 million users.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by human threat actors intentionally breaching the call center platform's management dashboard after the system was deployed.
A cyber breach of a Saudi Arabian AI-powered call center platform resulted in the theft of 10 million chat logs and national ID documents of 1 million users. While the incident represents a significant privacy failure and raises the risk of future identity theft and social engineering, its direct national security impact remains minor and manageable under standard cybersecurity protocols.
The AI systems are described as conversational chatbots and virtual agents that assist users by processing inquiries, simulating human conversations, and automating customer support workflows.
Limited Risk: The report describes an AI-powered conversational call center platform utilizing chatbots, which falls under Risk Level 3 as it involves AI systems interacting with humans.
The AI system's primary function is to act as a conversational chatbot to interact with consumers and automate customer support workflows.
The reports provide consistent and detailed information regarding the nature of the data breach, the volume of compromised records, and the specific types of sensitive data exposed.
The incident could be viewed purely as a traditional SaaS database breach, but the central role of conversational AI in gathering and retaining the sensitive chat logs makes it an AI safety and privacy incident.
Technology
Insecure Management Dashboard
Attackers gained unauthorized access to the platform's control dashboard.
Vulnerable API Token Management
Token manipulation allowed malicious injection into integration channels.
Black Box AI Architecture
Lack of transparency regarding data protection and retention in AI systems.
Data Inputs
Unsanitized PII Retention
AI system retained national IDs and sensitive customer data in chat logs.
Lack of Input Minimization
Users uploaded sensitive files directly to the conversational AI bot.
Human Factors
Compromised Engineer VPN
Attackers stole VPN and admin credentials belonging to an engineer.
Unwarranted Trust in AI Agent
Users assumed the AI session was secure, exposing them to hijacking.
Process and Methods
Inadequate AI Risk Assessment
Systems were deployed without comprehensive AI supply chain risk assessments.
Lack of Zero-Trust Mindset
Failure to assume breaches would occur in third-party hosted AI systems.
Management
Poor AI Supply Chain Control
Management absorbed third-party AI risks without proper governance.
Inadequate Data Retention Policy
Management failed to enforce strict limits on retaining customer chat logs.
Regulatory Environment
Weak AI Data Governance Rules
Regulatory frameworks did not enforce strict PII sanitization in AI models.