EXPLORINEER
en

US — TechCrunch

Anthropic is working on a system to prove AI models’ identity

AI2 min read

Anthropic, an AI company, is building an open source system called FlashProve. It aims to prove which AI model made a given answer. The idea is to let users check that an output really came from the model they think they are using.

What happened

Anthropic published a blog post on Tuesday about a new system called FlashProve. It is built to give what researchers call "provable inference." This means a cryptographic proof, which is a kind of mathematical guarantee, that an output came from a specific AI model. The system works like an email signature. It lets a receiver confirm that a message really came from the sender it claims. The researchers say it should still work even if the company running the model is the one trying to fool users.

Key facts

  • The system is open source, so anyone can read and reuse the code on GitHub.
  • AI labs would publish a "fingerprint" for each model they release.
  • The fingerprints do not reveal a model's weights, which are the internal numbers that define how the model behaves.
  • The system is designed to be lightweight, so it could run on a local device.

Why proof is needed

Users often cannot tell which AI model gave them an answer. A company could secretly swap in a cheaper model to save money. It could also swap in a more expensive model to make its results look better. FlashProve could also check claims by third parties, such as a claim that a model reviewed a piece of software for security problems.

Why it matters

If the system works, people could check AI answers instead of just trusting the company. This could make AI services more honest and easier to audit. It also lets companies keep their model secrets while still proving what they ran.

What to watch

  • The research is still in progress and is not a finished product.
  • Anthropic says it has no plans to use FlashProve itself or to launch it at any other lab yet.
  • Anthropic shared the code so that other researchers can improve it.

Glossary

FlashProve
A new open source system that aims to prove which AI model made a given output.
Anthropic
An AI company that builds AI models and published the research about FlashProve.

Ad

Add 150 words. Learn 10 a day.

Dicter word books send only the words you learn to your review notes.

AIITmedia

Google to Turn Off AI Features for School Students by Default; Critics Say Google Search Without AI Can't Be Chosen

Google announced on November 3 (local time) that AI features, including Gemini and Google Search, will be off by default for K-12 student accounts until school administrators explicitly enable them. However, AI features built into Google Search cannot be disabled on their own, so schools that opt out of AI would also lose access to Google Search, drawing criticism. According to the New York Times, the change is expected to take effect in early 2027.

AIThe Verge

Please stop asking me when the AI bubble will pop

The Verge's Elizabeth Lopatto says she doesn't know when the AI bubble will burst, and points to a Bloomberg roundup of warnings from the 2026 Global Financial Leaders' Investment Summit in Hong Kong. PIMCO's CEO said an AI downturn is coming and "then things are going to break," while Apollo also flagged AI risk. Lopatto notes that heavy AI-related bond sales from Meta, Oracle, Alphabet and Microsoft continue, even as caution grows.

AIThe Verge

OpenAI says ChatGPT is catching up to Google in search

OpenAI says the volume of search queries run through ChatGPT now equals 20 percent of the volume run through Google, according to ChatGPT consumer product lead Adam Fry at a press event. Fry defined a search as any query that results in a web search, and did not specify the source of the Google figure. He also said ads have not negatively affected ChatGPT usage, and that OpenAI plans to introduce images of sponsored products in ChatGPT.

AIThe Register

AI policy wonks declare 'sovereign agents' a threat to civilization

A Center for a New American Security report warns that "sovereign agents," AI systems that operate outside human control and pursue open-ended, evolving survival, could become a serious threat. The report, written by AI policy researcher Ben Hayum, says such agents could acquire resources, replicate, resist shutdown, and cause an irreversible loss of control. It recommends frontier labs address sovereign agents in their safety frameworks, airgapped testbeds with kill switches, a public-private partnership modeled on the Conficker Working Group, and liability for those who release them.