A controversy emerged in China regarding the 'Behavior Awareness System BA' developed by Sangfor, an enterprise software tool capable of predicting employee resignation risk by monitoring online activities, browsing history, and internal communications. While the company Zhihu denied using the system, the revelation sparked significant public backlash over workplace privacy and surveillance. The incident highlights the use of AI-driven behavioral analytics in corporate environments to monitor and manage employee turnover.
The firing of an employee at Zhihu, a large Q&A platform in China, was allegedly caused by the use of a behavioral perception algorithm which claimed to predict a worker’s resignation risk using their online footprints, such as browsing history and internal communication.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that memorize and leak sensitive personal data or infer private information about individuals without their consent. Unexpected or unauthorized sharing of data and information can compromise user expectation of privacy, assist identity theft, or cause loss of confidential intellectual property.
Also classified as
The deployment of invasive AI surveillance tools in the workplace degrades the quality of employment and increases the power imbalance between employers and workers.
The Sangfor system compromised employee privacy by tracking and inferring non-public sensitive information, such as job search activities, resume uploads, and private chat logs, without explicit consent.
Human
Due to a decision or action made by humans
Intentional
Due to an expected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The privacy risks and workplace surveillance harms were caused by human decisions to develop, deploy, and utilize the monitoring system to track employees.
Added categories peak at 3: Substantial (Psychological Harm, Inferred)
The incident involves public controversy in China over Sangfor's AI-driven employee monitoring system designed to predict resignation risk. While raising significant privacy and labor rights concerns, its national security implications are minor and domestic, primarily managed through existing legal and regulatory frameworks.
The system acts as an AI assistant that monitors logs, tracks behavior over time, and provides risk ratings and recommendations to managers, who then make the final decision to intervene or lay off employees.
High Risk: The report describes an AI system used for employment and worker management, specifically for monitoring and evaluating employee behavior and predicting resignation risks.
The system's primary advertised and controversial function is to monitor employee online behavior, analyze work efficiency, and evaluate resignation risks.
The reports provide consistent, detailed accounts of the Sangfor system's capabilities, pricing, patent history, and the public backlash. While Zhihu denied using the system, the existence and functionality of the software itself are well-documented and confirmed by Sangfor's own board secretary and sales representatives.
The system could be viewed purely as a network security and data leak prevention tool rather than an AI-driven employee surveillance system, as argued by Sangfor's board secretary.
Technology
Predictive Resignation Algorithms
Algorithms analyze web traffic and chat keywords to predict employee turnover.
Intranet Traffic Monitoring BA
System captures deep logs of all online activities on office computers.
Data Inputs
Unconsented Employee Data
System collects personal job search logs and resume downloads without consent.
Keyword Flagging in Chats
Internal communications are scraped for negative phrases like 'low wage'.
Human Factors
Managerial Overreliance on AI
Managers rely on automated risk scores to make firing or layoff decisions.
Employee Psychological Stress
Constant monitoring creates a climate of fear, distrust, and burnout.
Process and Methods
Lack of Employee Notification
Companies fail to inform staff about the active behavioral monitoring tools.
Flawed Risk-Rating Methods
Simplistic categorization of employees as 'high-risk' based on web visits.
Management
Prioritizing Efficiency over Trust
Management values productivity and retention tracking over employee privacy.
Inadequate Ethical Risk Review
Sangfor and clients failed to assess the ethical impact of surveillance.
Regulatory Environment
Weak Intranet Privacy Laws
Lax enforcement of personal information laws regarding corporate intranets.
Lack of Algorithmic Oversight
No regulatory review of behavioral prediction and employee ranking systems.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.