This is a research prototype. The data and analyses are preliminary and not yet validated — we'd welcome your .
Privacy activist Bankston reported that Google's Gemini AI appears to be accessing private PDF documents in Google Drive without explicit user consent. Bankston claims that once Gemini is triggered on one document, it automatically processes subsequent files of the same type, even when settings indicate the feature is disabled. Google disputes these claims, stating that Gemini requires proactive activation and operates within privacy-preserving settings, suggesting the behavior might be related to legacy Workspace Labs settings or the use of the Drive side panel.
Kevin Bankston, a privacy activist, claims that Google's Gemini AI scans private Google Drive PDFs without explicit user consent. Bankston reports that after using Gemini on one document, the AI continues to access similar files automatically. Google disputes these claims, stating that Gemini requires proactive user activation and operates within privacy-preserving settings.
Domain classification, causal taxonomy, severity scores, and national security assessments were LLM-classified and may contain errors.
AI systems that memorize and leak sensitive personal data or infer private information about individuals without their consent. Unexpected or unauthorized sharing of data and information can compromise user expectation of privacy, assist identity theft, or cause loss of confidential intellectual property.
Also classified as
The system failed to reliably respect user settings and toggles, representing a lack of robustness in its control interface.
The incident involves an AI system accessing and processing private, non-public documents in Google Drive without explicit user consent.
AI system
Due to a decision or action made by an AI system
Unintentional
Due to an unexpected outcome from pursuing a goal
Post-deployment
Occurring after the AI model has been trained and deployed
The incident was caused by an unexpected behavior or glitch in the Gemini AI system automatically processing files despite user settings being disabled.
A privacy activist reported that Google Gemini automatically accessed and summarized private Google Drive PDFs despite disabled settings. While highlighting potential data privacy and user consent issues within cloud platforms, the incident represents a minor software configuration or behavioral issue with negligible direct national security implications.
The AI system, Google Gemini, is designed as an AI assistant to help users summarize and analyze documents. In this incident, it acted automatically to process documents, but its primary mode of operation is to assist users within Google Workspace.
Risk Level 3: Limited Risk. The system involved is Google Gemini, which operates as a chatbot and general-purpose AI assistant within Google Workspace, falling under the Limited Risk category.
The primary function of Gemini in Google Workspace is to act as a writing assistant and answer questions about user documents.
The report provides a detailed account from a privacy activist, but Google disputes the assertions, suggesting alternative explanations like side-panel usage or legacy settings. This creates some ambiguity about the exact technical cause of the behavior.
The behavior could be an intended feature of the side panel that the user misunderstood, rather than a privacy bug or glitch.
Technical logs or independent verification confirming whether Gemini processed the files without any user interaction and despite disabled settings.
Technology
Workspace Labs Override
Workspace Labs enrollment in 2023 may override current Gemini settings.
Automatic File Type Trigger
Using Gemini on one file type triggers auto-summarization on future files.
Persistent Side Panel State
Keeping the side panel open causes Gemini to automatically read new files.
Data Inputs
Automatic Document Access
Gemini automatically ingests open document content without explicit consent.
Human Factors
Prior Workspace Labs Opt-In
User opted into legacy Labs program, leading to unexpected settings override.
Lack of UI State Awareness
User did not realize keeping the side panel open would trigger auto-scans.
Process and Methods
Inaccurate Settings Guidance
Gemini bot provided incorrect locations for privacy settings toggles.
Ineffective Toggle Enforcement
System failed to respect the disabled state of Gemini summaries in Drive.
Management
Inadequate Settings Design
Google placed critical privacy toggles in non-intuitive locations.
AI system involved
Identified by automated extraction; can differ from the alleged developers above.
