welclaiAI·TREND·DIGEST
Policy

Liability when AI gets it wrong

When an AI system causes harm, who is responsible? A plain-language map of how accountability is reasoned about when there is no single obvious culprit.

policy2026-04-18 16:42 KST·Lead Editor·7 min read

When an AI system causes harm — a bad recommendation that costs money, a faulty output that injures someone, a discriminatory decision that damages a life — a hard question follows: who is responsible? The intuitive answer, "the AI," is a dead end. A model is not a person; it cannot be held accountable, cannot intend, cannot pay. So responsibility has to land on someone human or some organization, and figuring out who is the heart of AI liability. This piece maps how that reasoning works in plain language. It is general information, not legal advice, and the specifics vary by place and situation.

Why "the AI did it" resolves nothing

The instinct to blame the system itself is understandable and useless. Liability exists to do practical work: to compensate those harmed, to deter careless behavior, and to assign the cost of mistakes to those best positioned to prevent them. A model can do none of this. It has no assets, no duties, no capacity to be deterred.

So when harm occurs, the real question is which human actor or organization in the chain bears responsibility. The presence of an AI system does not dissolve accountability; it just makes locating it harder, because there are more hands in the process and each can point at the others. The work of AI liability is cutting through that diffusion to find the responsible party.

The chain of possible responsibility

Between an AI system's creation and the harm it causes, several parties have a hand, and any of them might bear responsibility depending on what went wrong:

  • The developer who built and trained the model.
  • The deployer — the company that integrated it into a product or service and put it in front of people.
  • The operator or user who chose to use it for a particular task, perhaps outside its intended scope.
  • The data providers whose data shaped the system's behavior.

Harm rarely traces to a single link. A model flawed in development, deployed without adequate testing, and used for something it was never meant for distributes fault across the chain. Much of the difficulty — and much of the negotiation in contracts and disputes — is about apportioning responsibility among these parties.

Existing legal ideas usually apply first

A common misconception is that AI harm needs entirely new law. Often it does not. Long-standing legal concepts already reach a great deal of AI behavior, and they tend to be the first tools applied.

Ideas like negligence — failing to take reasonable care — can apply to a company that deployed a system carelessly. Product-related responsibility can apply when something is sold as a product that turns out to be defective. Anti-discrimination obligations apply to a biased outcome regardless of whether a human or a model produced it. Contractual terms govern what was promised between businesses. The throughline is that harm is often harm under existing law, and the involvement of AI does not grant immunity. Where law evolves specifically for AI, it usually adapts these familiar ideas rather than starting from scratch.

What makes AI liability genuinely hard

If existing ideas apply, why is this a live problem? Because AI strains several assumptions those ideas rest on:

  • Opacity. Liability often turns on showing what went wrong and why. When a system's reasoning is hard to inspect, proving the cause of a harm becomes difficult for everyone involved.
  • Autonomy. The more independently a system acts, the harder it is to tie an outcome to a specific human choice — the link between decision and consequence stretches.
  • Diffusion. With many parties contributing, each can plausibly blame the others, and assigning proportions is messy.
  • Foreseeability. Responsibility frequently depends on whether harm was foreseeable. Systems that behave in unexpected ways complicate the question of what anyone should have anticipated.

These are not reasons accountability disappears. They are reasons it is contested, and why careful documentation and testing matter so much — they are often what makes responsibility provable one way or the other.

How responsibility gets allocated in advance

Much of real-world AI liability is settled before any harm occurs, through deliberate allocation. Businesses use contracts to decide who bears which risks — warranties, disclaimers, and indemnities that move responsibility between developer, deployer, and user. Insurance spreads the cost of harms that do happen. Terms of service attempt to define and limit a provider's exposure to end users.

This is why the question "who is liable?" often has a contractual answer layered on top of the legal one. Two companies can agree, within limits, on who absorbs the cost if a system fails. Those limits — what disclaimers actually hold up, what cannot be contracted away — are exactly where qualified legal advice earns its keep, and where assumptions made casually become expensive.

Practical lessons for anyone deploying AI

You do not need to predict every legal outcome to behave defensibly. A few principles reduce both real harm and exposure:

  • Match the use to the system's intended scope. Using a tool for something it was never designed for is a fast route to being the responsible party.
  • Keep humans in consequential decisions. Meaningful human oversight for high-stakes outcomes both prevents harm and clarifies accountability.
  • Document testing and decisions. Records of diligence are often what determines responsibility when something goes wrong.
  • Read the contracts and terms. Know what you have accepted and what you have promised before you rely on a system, not after.
  • Get real advice for high-stakes uses. Where serious harm is possible, qualified legal counsel is part of doing it responsibly.

The takeaway

When AI causes harm, "the AI did it" is never the answer, because a model cannot bear responsibility — some human or organization must. Locating that party means tracing a chain from developer to deployer to user, applying legal ideas that mostly already exist, and working through what makes AI genuinely hard: opacity, autonomy, diffusion of fault, and uncertain foreseeability. In practice, much responsibility is allocated ahead of time through contracts, insurance, and terms. The durable lessons are to use systems within their intended scope, keep humans in high-stakes loops, document diligence, and get qualified advice where harm could be serious. Accountability does not vanish because a machine was involved — it just takes more care to find. This article is general information, not legal advice; for specific situations, consult a qualified attorney.

#liability#accountability#governance#risk

Primary sources

NISTWIPO