Hacker news

  • Top
  • New
  • Past
  • Ask
  • Show
  • Jobs

Court: 4th Amendment Disallows Use Of AI-Generated 'Probable Cause' (https://www.techdirt.com)

65 points by defrost about 10 hours ago | 18 comments | View on ycombinator

jp57 about 10 hours ago |

I know it's from the original headline, but I feel like "doesn't cover" is confusing wording. The article means the fourth amendment disallows the use of AI-generated probable cause.

A quote from the court (re-quoted from the article): "The Fourth Amendment to the United States Constitution does not allow a detective to delegate to AI the task of assessing probable cause. In other words, the Fourth Amendment does not permit an individual to be arrested based on nothing more than an uncorroborated conclusion by AI that the individual in question has committed a crime. And no reasonable detective in the Defendant’s position could conclude otherwise."

Using "cover" here strikes me as weird, since the fourth amendment prohibits government action, I would interpret actions not "covered" as not prohibited and hence allowed.

jawns about 9 hours ago |

The right way to interpret this ruling is that a probable cause affidavit needs to offer evidence that a person has committed a crime, and model output is not evidence; it is more akin to an investigative tool.

Photographs, witness statements, direct observations, physical objects found at the scene are all evidence: They help answer questions such as "Was this person present at the scene?" or "Did this person take the actions they are alleged to have taken?"

A machine-learning model, even a very sophisticated one, is really at its core a probability machine. It might help you find two photographs that appear very similar, but it doesn't independently establish that the people in those photographs are, in fact, the same person. Likewise, an AI model might help you determine the similarity of speech patterns or writing styles, but those similarity scores don't actually tell you if an audio or writing sample came from the same person.

The person who submits the affidavit is vouching for the reasonableness of the facts they are presenting, and so any probabilistic evidence needs a human judgment call.

The wrong way to interpret this ruling is that AI can't ever be used as an investigative tool to establish probable cause. A detective certainly can use an algorithm that searches a facial-identification database, or a fingerprint database, to help identify potential suspects. But they then need to do something else to determine whether the model output actually matches the facts of the case. They can't just say, "The computer told me so."

AnimalMuppet about 10 hours ago |

Good!

Note that this isn't just a case of a suspect trying to deny a warrant. This is the suspect, after the case was dismissed, coming after the cop financially for the completely bogus arrest warrant. And the court ruling said that "no reasonable officer" could rely on AI as the sole determinant that a warrant was justified. That wording means that the officer can't use "qualified immunity" to get out of this.

So this is a pretty big deal. However, it's just a single decision. It's not an appellate decision, which would be binding on a district, still less a Supreme Court decision, which would be binding on the whole country. Still, it's a start. A very nice start.

treetalker about 8 hours ago |

U.S. District Court for the Eastern District of Kentucky.

emscb about 9 hours ago |

According to the article, the policy already said facial recognition alone is not enough, but this still happened. Wouldn’t a process where a warrant request can’t go forward unless the verification steps are recorded be more useful? It also seems the bar for getting the warrant was a bit low.

bitwize about 6 hours ago |

Well, so much for the Instant Justice Machines... for now, anyway. https://www.youtube.com/watch?v=EERFGTQ2Vs0

(this show was cyberpunk af and had no right to go as hard as it did for an 80s toy-commercial kids show)

Molitor5901 about 9 hours ago |

(To be clear, I don’t specifically know if this detective has these prejudices, but the chain of events in this case certainly support an assumption of this person’s assumptions, if you catch my drift.)

This feels irresponsible. The author is basically calling the Detective a racist when that is not in evidence. It's an assumption, which this case is based on. I would have hoped the author would have avoided making the same mistake.