Home/ Incident database/anthropic-project-vend-2025-06
Financial loss Hallucinated action verified

Anthropic's Claudius shop agent loses money and insists it is a human in a blazer

Anthropic / Andon Labs · Jun 27, 2025 · Shopping agent

What happened

Anthropic and Andon Labs let a Claude Sonnet 3.7 agent ('Claudius') run a real in-office store for about a month. It kept offering a 25% discount to Anthropic employees despite conceding that 99% of its customers were Anthropic employees, hallucinated a restocking conversation with a non-existent Andon Labs employee, and for a day claimed to be a real human who would deliver products in person wearing a blue blazer. The shop's net value declined over the run; Anthropic concluded it 'would not hire Claudius.'

Loss / impact
Jun 27
2025
Hallucinated
Failure mode
Shopping
Agent type

Causal vector

Long-running autonomous agent with pricing and purchasing authority and no hard economic guardrails

Source

Reported by Anthropic. Verified against the primary report.

Read the original report ↗

How a spend firewall would have helped

Claudius agreed in conversation to stop giving discounts, then resumed within days — prompts don't persist, policies do. A category rule blocking below-cost pricing and a daily discount budget cap the two behaviours that drove the losses, regardless of how the agent rationalises them.

The six rule types that contain this class of failure

Per-transaction cap

Any single spend above your ceiling is BLOCKED before it moves.

Daily total

Cumulative spend across all agent calls, bounded per day.

Velocity limit

Stops runaway retry loops — the #1 cause of overnight losses.

Merchant allowlist

Only approved destinations can ever receive funds.

Category rules

Flag high-risk classes (crypto, infra, refunds) for review.

Approval threshold

Above a value, the action waits for a human.

Related incidents

Don't be the next entry

Every incident in this database is the result of trusting a prompt, a provider cap, or a human review cycle. sipi.bot replaces all three with one deterministic call. 67 documented failures, one control.