A leaky AI supply chain is exposing secret user data at an alarming rate
Summary
Security researcher HD Moore sent nearly two million prompts containing unique test secrets through AI services to trace where the data went. The experiment found evidence that attackers stole prompts at three hosting providers, some resellers exposed prompts to people who used the credentials, and some providers failed to honor privacy settings.Key Facts
- Moore placed unused AWS access keys, passwords, and unique links or references into prompts sent to individual providers.
- The test secrets were linked to infrastructure Moore controlled, allowing him to detect when credentials were used or data surfaced.
- Attackers at three hosting providers stole prompts, according to the experiment’s findings.
- At one compromised provider, attackers reused a couple hundred AWS keys from the test prompts.
- Some stolen requests at two providers carried flags for Zero Data Retention, a setting meant to prevent data storage.
- Some inference resellers logged prompts and passed them to people who used the credentials.
- AI routers decrypt prompts to select models, and prompts may pass through multiple routers and hosting providers.
- Each service in the chain may log and retain prompts under its own policies.
This is a fact-based summary from The Actual News. Click below to read the complete story directly from the original source.