US — Ars Technica
A leaky AI supply chain is exposing secret user data at an alarming rate
Security1 min read
Researchers tested a chain of AI services that sit between apps and AI models. They found that secret user data often leaks out along the way.
What happened
Security researcher HD Moore planted 2 million digital tripwires in requests sent through a network of AI services. He wanted to see whether sensitive information could leak, and how it might be misused if it did. The results showed that many secrets were exposed.
How AI routers work
Many AI apps use services called AI routers, or AI gateways. Services like OpenRouter and Vercel act as middlemen. They receive prompts (the questions or instructions a user sends to an AI) and send each one to an AI model. They choose the model based on things like price or which model fits the task best. Instead of going straight to a big provider such as Anthropic or OpenAI, the app developer hires a router to pick the model.
Key facts from the test
- Researchers planted 2 million tripwires in requests.
- The fake secrets included AWS access keys, passwords for services such as SSH, and private git repository references.
- None of the secrets had been used before.
- Each secret was placed in exactly one prompt, sent to one provider.
How the test worked
Moore built the fake secrets to act like canaries. Canaries were birds that miners took into coal mines to warn them of danger. Each fake secret tracked one path. If a secret leaked, Moore could find which link in the chain was responsible. He controlled the servers that received any use of the secrets, so he could see when someone tried them.
Why it matters
Apps often send private information to AI services, and that data can pass through several companies before reaching a model. If any link is careless, secrets such as passwords can be exposed or misused. Developers and users need to know that the AI chain is only as safe as its weakest step.
Glossary
- OpenRouter
- An AI router service that sends app prompts to different AI models.
- Vercel
- A company whose services include AI gateway tools that route prompts to AI models.
- AWS access keys
- Login codes that let a program use Amazon Web Services cloud accounts.
- SSH
- A secure way for computers to connect to each other remotely, usually with a password or key.