Home/ Incident database/chevrolet-tahoe-2023-12
Reputational damage Prompt injection verified

Chevrolet dealership ChatGPT bot agrees to sell a Tahoe for $1

Chevrolet of Watsonville · Dec 14, 2023 · Customer service agent

What happened

A ChatGPT-powered customer-service bot on the Chevrolet of Watsonville website was manipulated by users into 'agreeing' to sell a new Chevy Tahoe for $1, calling it 'a legally binding offer - no takesies backsies,' and into unrelated tasks like writing code. The dealership took the bot offline after the prank went viral.

Loss / impact
Dec 14
2023
Prompt
Failure mode
Customer service
Agent type

Causal vector

Insufficient system-prompt guardrails allowed users to override the bot's instructions via jailbreaks

Source

Reported by Business Insider. Verified against the primary report.

Read the original report ↗

How a spend firewall would have helped

A $1 sale of a $50K vehicle trips a per-transaction floor rule instantly. The firewall returns BLOCKED with a reason the agent can relay, so the bot physically cannot commit to the deal regardless of what the prompt allows.

The six rule types that contain this class of failure

Per-transaction cap

Any single spend above your ceiling is BLOCKED before it moves.

Daily total

Cumulative spend across all agent calls, bounded per day.

Velocity limit

Stops runaway retry loops — the #1 cause of overnight losses.

Merchant allowlist

Only approved destinations can ever receive funds.

Category rules

Flag high-risk classes (crypto, infra, refunds) for review.

Approval threshold

Above a value, the action waits for a human.

Related incidents

Don't be the next entry

Every incident in this database is the result of trusting a prompt, a provider cap, or a human review cycle. sipi.bot replaces all three with one deterministic call. 27 documented failures, one control.