It’s baseball season again, and that means it’s time again to embrace the chronic self-harm of being a Mets fan (already off to a stellar 1-6 start), but also, this year especially, to ponder the ways in which technology risks making some things worse by making other things better.
That’s because this season was originally supposed to be the one where Major League Baseball began introducing robot umpires to call balls and strikes. The idea was to use new technology to make an old game more perfect, less arbitrary, more objective.
But after a few seasons of trials in the minor leagues, the robots’ march to the Majors slowed. It turns out, players and managers weren’t as thrilled about putting about Hal 9000 behind the plate as MLB thought.
The challenges of defining an objective and consistent strike zone, and the misgivings about removing human judgment altogether, have pushed back the robots’ debut for at least another season – if not more.
To be up front, I think that’s a good thing. Maybe I’m just yelling at clouds here, but to me the subtle arbitrariness of a strike zone – unlike, say, the objective reality of a safe/out call – is an intrinsic part of the short story that is a baseball game.
But all of this got me thinking about another more consequential area where people’s appetite for technological “accuracy” is milder than you’d think: the courtroom.
Of all the institutions in a democracy, judges and courts have perhaps the highest duty to be – and to be seen as – impartial. And yet a growing number of Americans no longer see the bench that way. Overall, fewer than 50% of Americans say they trust the judicial branch of the federal government, the lowest mark on record, and only half of Americans say criminal suspects are treated “fairly” – down from roughly two-thirds at the turn of the century.
Each side has its grievances. For many Republicans, the Biden administration has co-opted the courts as part of a banana republic style bid to sideline Trump with frivolous legal charges. Democrats, meanwhile, see the Supreme Court as hopelessly illegitimate and biased because Trump gave it an overtly conservative majority that, as anticipated, rolled back Roe v. Wade.
Can technology help? In one small corner of the justice system at least, it seems so. For several years now, AI programs have been used to assist judges in specific areas – such as determining bail – where machine learning can use vast amounts of past data to make predictions about future behavior.
America already jails more people than any country on earth, and fully a quarter of those in prison are merely awaiting trial, often for months at a time. But studies show that AI can improve things.
In one survey from 2017, an AI program was 25% more accurate than human judges when it came to predicting whether suspects released on bail would flee or commit more crimes. Using AI would also, the study found, have safely reduced the pretrial prison population by some 40%. Several states have found that using algorithms can help reduce pre-trial prison populations without an increase in crime.
That’s all good. But there’s one problem: People in general still don’t seem to want robots in the courtroom. A YouGov study from last year showed that barely 1 in 5 Americans thought a robot would “be a better judge,” while 56% preferred a “human who can use their emotion and instinct.” A broad survey of judges and other court workers found that two thirds were skeptical about using AI in the courtroom, citing concerns about accuracy and emotional intelligence.
There are, of course, problems with AI in criminal justice. One is the risk of bias. After all, if AI is what it eats, then training AI modules on decades of policing and court data shaped by systemic racial or socio-economic biases risks teaching robots to amplify them further. The ACLU has highlighted this problem in algorithms used for policing and pre-trial detention.
Another issue is transparency. These algorithms are a black box – private sector trade secrets guarded as closely by tech companies as KFC protects its spice recipe or Coke guards its formula. If a computer decides to jail you, you’d probably never know why – was it an AI hallucination that shipped you off to Rikers Island?
But a big issue is more basic: People just aren’t comfortable with a box of ones and zeros making decisions that depend on assessments of our character, our emotions, or humanity. There’s a kind of alienation there that people aren’t comfortable with, even if the accuracy is greater and the societal benefits can be modeled.
The problem is a delicate one. On the one hand, if we’re forgoing real improvements – fewer people in jail and safer streets at the same time – we are needlessly harming large numbers of people over a mistaken belief in the ability of people to judge other people fairly.
But in a deeply polarized and increasingly mistrustful society, introducing technologies that aim to make our institutions more accurate may also, paradoxically, cause people to trust them less.
Let me know what you think about robots at the ballpark or in the courtroom here – if you include your name and city, we may run your response in a future edition of the GZERO Daily newsletter.