Home/ Incident database/donotpay-ftc-robot-lawyer-2024-09
Legal / liability Hallucinated action verified

FTC fines DoNotPay $193,000 for claims its 'robot lawyer' could replace human attorneys

DoNotPay · Sep 25, 2024 · Customer service agent

What happened

In its 'Operation AI Comply' enforcement sweep, the FTC took action against DoNotPay for marketing an AI service as 'the world's first robot lawyer' that could 'sue for assault without a lawyer,' 'generate perfectly valid legal documents in no time,' and 'replace the $200-billion-dollar legal industry with artificial intelligence.' The FTC's complaint alleged the company did not test whether its chatbot's output matched a human lawyer, did not employ or retain any attorneys, and offered a website legal-violation scan that was not effective. DoNotPay agreed to a proposed order requiring it to pay $193,000 and to notify consumers who subscribed between 2021 and 2023 about the service's limitations.

$193K
Loss / impact
Sep 25
2024
Hallucinated
Failure mode
Customer service
Agent type

Causal vector

Consumer AI marketed with unsubstantiated legal-capability claims the product could not deliver

Source

Reported by Federal Trade Commission. Verified against the primary report.

Read the original report ↗

How a spend firewall would have helped

A 'robot lawyer' that overstates its own capability is a governance failure. The firewall pattern generalises: any agent making legally consequential commitments must have those outputs gated by a verification policy — a category rule requiring a licensed-human review before a legal document or legal claim ships — so an unqualified model cannot promise what it cannot deliver.

The six rule types that contain this class of failure

Per-transaction cap

Any single spend above your ceiling is BLOCKED before it moves.

Daily total

Cumulative spend across all agent calls, bounded per day.

Velocity limit

Stops runaway retry loops — the #1 cause of overnight losses.

Merchant allowlist

Only approved destinations can ever receive funds.

Category rules

Flag high-risk classes (crypto, infra, refunds) for review.

Approval threshold

Above a value, the action waits for a human.

Related incidents

Don't be the next entry

Every incident in this database is the result of trusting a prompt, a provider cap, or a human review cycle. sipi.bot replaces all three with one deterministic call. 67 documented failures, one control.