AI & Automation

Where the argument over AI and automation actually runs, what the case for building fast and the case for oversight protect, and the accountability both want.

The application is declined. The letter is courteous, the phone line is answered, and the person who answers it cannot say why, because nobody in that building made the decision and nobody in it can reconstruct it.

That is where most of the American argument about artificial intelligence actually sits: not in speculation about machines that wake up one morning, but in the distance between a decision about a person and anyone who can account for it — and in whether the skill someone spent years acquiring is about to be worth less, and what is owed to them if it is.

Where the divide is

The first disagreement is about whether we have been here before. One account holds that machines have been eliminating categories of work for as long as there have been machines, that the permanent unemployment predicted each time did not arrive, and that the work which replaced what was lost was mostly not imaginable from inside the transition — so humility is owed to a forecast that has failed repeatedly. The competing account does not deny that pattern. It denies that a pattern is a guarantee. What is arriving now reaches into judgment and language rather than muscle; it arrives across many fields at once rather than one trade at a time; and an average that holds across generations is cold comfort to a person with one working life and rent due on a fixed schedule. Both positions are held by serious people, and neither is a slogan.

The second disagreement is about oversight, and it is not the argument the headlines stage. Consequential decisions — an interview, a loan, an apartment, a benefit, a place in a queue — are increasingly shaped by systems outsiders can judge only by their outputs. One side wants rules in place before harm, on the ground that you cannot un-deny someone a mortgage. The other answers that rules written now will be drafted by people who cannot describe what they are regulating, that compliance is a fixed cost a large firm absorbs and a small competitor cannot, and that a regime justified by safety tends to end with whoever was already largest holding the field alone.

A third divide runs through what counts as harm. Asked to make a system behave better, one person means it should stop producing outcomes that track race, sex or an address; another means it should stop quietly enforcing one set of political assumptions. Each hears the other's request as installing a bias rather than removing one.

The fourth is about who ends up holding the gains. When a technology makes an hour of work produce more, the extra value goes somewhere, and where it goes is settled by bargaining power rather than by arithmetic — the argument that runs through Worker Rights.

What each side is protecting

People who want this built quickly and governed lightly are protecting benefits already concrete to them. Help with a diagnosis in a town with no specialist. A small business doing work that used to require a department it could not staff. They are protecting the person for whom expertise has always been priced out of reach, and their claim is that this good arrives quietly and gets counted late, while every fear is counted immediately. They are also protecting against a familiar maneuver: a predicted catastrophe used to justify handing control of something new to whoever is already big enough to be in the room when the rules are drafted.

People who want limits are protecting the person on the receiving end. Their central claim is that a decision about someone is owed a reason, and that "the system flagged it" ends a conversation rather than answering one. They are protecting a worker whose craft took years to build and now competes with something that does a passable version of it instantly and for almost nothing — not because anyone is owed a frozen world, but because being told you are a rounding error in someone else's progress is not an answer. And they are protecting against speed itself: a change absorbable across a working life is not the same change compressed into a handful of them.

Both are protecting human agency, from opposite ends. One fears a machine that decides and cannot be asked why. The other fears a committee that decides what may be built and, once seated, cannot be voted out. Neither fear is foolish, and most people carry some of both.

Where the common ground is

The position here is that the gains from automation are worth having and should not be gathered by a narrow group while the disruption is billed to everyone else — retraining that exists before the layoff, a safety net that does not require destitution as an entry fee, tax treatment not quietly indifferent between employing a person and replacing one, and oversight answering to voters rather than only to shareholders. Less of that is partisan than the shouting suggests.

Start with what almost nobody defends. That a person should be able to learn a decision about them was made or shaped by a system, and have it looked at by a human who can be asked why. That a system used for consequential decisions should be testable by someone other than its owner. That you should be able to tell whether you are talking to a person. That impersonating a real person — their face, their voice, their signature — is fraud in a new medium, not a new kind of expression. That children are a distinct case.

The audit question is common ground of an unusual kind, because two opposite suspicions arrive at the same request. The person who believes these systems quietly disadvantage people like them and the person who believes they quietly enforce a worldview both want the same things: to see what a system was built to do, to test whether it does that, and to appeal when it does something else. Neither notices the agreement, because each assumes the other wants the opposite. It is the same demand for accountable power that runs through Surveillance & Privacy.

One thing is worth insisting on: none of this is weather. Every one of these systems is built, bought and switched on by people who could have chosen otherwise, on a schedule someone picked. Describing it as an arriving season is how the choosing gets done without anyone being asked.

Questions worth asking

Discuss this on the board Join the movement