Hacker News new | past | comments | ask | show | jobs | submit

Innocent woman jailed after being misidentified using AI facial recognition

https://www.grandforksherald.com/news/north-dakota/ai-error-jails-innocent-grandmother-for-months-in-north-dakota-fraud-case
> According to the court documents, the Fargo detective working the case then looked at Lipps' social media accounts and Tennessee driver's license photo. In his charging document, the detective wrote that Lipps appeared to be the suspect based on facial features, body type and hairstyle and color.

> Once they were in hand, Fargo police met with him and Lipps at the Cass County jail on Dec. 19. She had already been in jail for more than five months. It was the first time police interviewed her.

How is this the fault of AI? It flagged a possible match. A live human detective confirmed it. And the criminal justice system, for reasons that have nothing to do with AI, let this woman sit in jail for 5 months before doing even interviewing her or doing any due diligence.

There's a reason why we don't let AI autonomously jail people. Instead of scapegoating an AI bogeyman, maybe we should look instead at the professional human-in-the-loop who shirked all responsibility, and a criminal justice system that thinks it is okay to jail people for 5 months before even starting to assess their guilt.

loading story #47357939
loading story #47357734
loading story #47357911
loading story #47357508
loading story #47357922
loading story #47357544
There's no way this isn't a slam dunk case to sue the piss out of the Fargo Police, probably the US Marshals and maybe other orgs. The woman in the surveillance phone clearly looks way younger, among the many other obvious signs this woman didn't do it. I hope she wrings at least several million dollars out of the government.
loading story #47357318
loading story #47357402
loading story #47357328
loading story #47357524
> facial recognition showed she was the main suspect in what Fargo police called an organized bank fraud case.

> Her bank records showed she was more than 1,200 miles away, at home in Tennessee at the same time police claimed she was in Fargo committing fraud.

> Unable to pay her bills from jail, she lost her home, her car and even her dog

It is an AI error, but also an error on the part of the cops, the prosecutors, the judge, and the county sheriff (who is responsible for the jail inmates). I hope everyone involved in this travesty is sued into oblivion and unable to hide behind their immunity defenses. Facial recognition should never be the sole basis for a warrant.
loading story #47357533
loading story #47357616
loading story #47357410
This reminds me of the British Post Office Scandal: https://en.wikipedia.org/wiki/British_Post_Office_scandal
loading story #47357420
loading story #47357893
Me: Whoa, cool, my hometown is on atop Hacker News!

Also me, reading further: Uh-oh.

The chief of police also resigned today; wouldn't be shocked if this was part of the reasoning.

loading story #47357574
loading story #47357510
>Unable to pay her bills from jail, she lost her home, her car and even her dog. Fargo police say the bank fraud case is still under investigation and no arrests have been made.

I smell a lawsuit

“Computers don’t argue” seemed charmingly wrong about how computers work until a few short years ago.

https://nob.cs.ucdavis.edu/classes/ecs153-2019-04/readings/c...

loading story #47357681
end qualified immunity.

see how fast cops start to do their jobs with care.

Even in Idiocracy they didn't have this problem
The movie "Brazil" was right!
loading story #47357378
loading story #47357397
{"deleted":true,"id":47357187,"parent":47356968,"time":1773349952,"type":"comment"}
{"deleted":true,"id":47357494,"parent":47356968,"time":1773351401,"type":"comment"}
It’s obvious from the one photo they posted of the actual suspect that the lady they arrested is about 20-30 years older than the woman in the bank photo. The woman in the photo is maybe 25-30 years old, this grandma looks like she’s 65-70 (actual age of 50).

Absolutely ridiculous, I hope she wins her civil case.

Wait - what was the AI tool and how did it have her face to begin with? If small-town police are doing face-matching searches across national databases then nobody is safe because the number of false positives is going to be MASSIVE by sheer number of people being searched every day.

Pretend the tool is 99.999999% specific. If it searches every face in the USA you're still getting about 3 false positives PER SEARCH.

You will never have a criminal AI tool safe enough to apply at a national scale.

AI or not, it's unconscionable that victims of compulsory legal processes by way of mistaken identity are not made whole.
loading story #47357929
loading story #47357466
I read the article and I don’t really understand… she was held in a jail in Tennessee but the article states they flew her to North Dakota? And somehow she’s a fugitive so that’s why she doesn’t get bail? but she’s a fugitive held in her own state in a holding facility? But then when they release her, she’s in North Dakota? So if some state says you’re a fugitive your home state will just hold you in jail until they come and put you on an airplane? Is that correct?
loading story #47357950
https://archive.is/yCaVV - Archive link to get around the paywall.

https://www.theguardian.com/us-news/2026/mar/12/tennessee-gr... - Another article on this without a paywall.

It's annoying that both articles are calling this AI error. This was human error, the police did the wrong thing and the people of Fargo will end up paying for this fuckup.

loading story #47358000
loading story #47357289
{"deleted":true,"id":47357322,"parent":47356968,"time":1773350629,"type":"comment"}
It's not an AI error. It's a human error in mis-using AI in this way. Saying it's an AI error is like saying a hole in your drywall is a hammer error.

Unfortunately we'll probably see a trend of people using AI and then blaming AI for cases where they mis-used AI in roles it's not good for or failed to review or monitor the AI.

loading story #47357585
Completely infuriating, but more of a commentary on the sad state of incompetent power-hungry law enforcement with tools they don't know how to use than the tools themselves.

Though, the question remains: are the tools built in such a way as to deceive the user into a false sense of trust or certainty?

_Some_ of the blame lies on the UX here. It must.

loading story #47357330
loading story #47357392
loading story #47357369
loading story #47357359
I hate this headline (not blaming submitter). Police incompetence and negligence jailed her for months and left her stranded in a North Dakota winter. The AI is no more responsible than the cars and airplanes they used.
loading story #47357207
loading story #47357354
loading story #47357975
loading story #47357231
loading story #47357795
I will keep saying this til I am blue in the face: we are at a crossroads. One path leads to displacing workers and suppressing wages to further concentrate wealth into the hands of elite Epstein acolytes. The other path leads to making all of our lives better by automating the menial tasks so we all have to work less. We are firmly headed down the first path.

This type of incident isn't new and is only going to get worse. The problem is our governments are doing absolutely nothing about it. I'll give two examples:

1. Hertz implemented a system where they falsely reported cars as being stolen. People were arrested and went to jail for rental cars that were sitting in the Hertz lot. Hertz ultimately had to pay $168 million in a settlement [1]. That's insufficient. If I, as an ordinary citizen, make a false police report that somebody stole my car I can be criminally charged. And rightly so. People should go to jail for this and it will continue until they do. These fines and settlements are just the cost of doing business; and

2. The UK government contracted Fujitsu to produce a new system for their post offices. That system was allowed to produce criminal charges for fraud that were completely false. People committed suicide over this. This went on for what? A decade or more? But resuted in a parliamentary inquiry and settlements. It's known as the British Post Office scandal [2]. Again, people should go to jail for this.

Everyone here is one LLM decision away from having their life ruined where nobody can explain why a decision was made, what the basis of that decision was and what can be done to fix it. No requirements exist to prove such claims. The burden falls on ordinary people to prove the claims are false.

[1]: https://www.npr.org/2022/12/06/1140998674/hertz-false-accusa...

[2]: https://en.wikipedia.org/wiki/British_Post_Office_scandal

Why the fuck does a newspaper need a ‘notifications’ icon in the top right hand corner?
loading story #47357638
loading story #47357509