A facial recognition algorithm used by a local roller skating rink in Detroit wouldn’t let teen Lamya Robinson onto the premises, and accused her of previously getting into a fight at the establishment.
But Robinson had never even been to the rink.
The facial recognition system had incorrectly matched her to another patron, she told
“To me, it’s basically racial profiling,” Juliea Robinson, her mother, told the TV station. “You’re just saying every young Black, brown girl with glasses fits the profile and that’s not right.”
The harms of facial recognition systems deployed in businesses and by police have been slowly coming to light as the technology is more widely used. Research into these algorithms has shown that they are
The highest-profile case of facial recognition leading to a wrongful arrest was also in Detroit, in the case of Robert Williams. Williams was arrested and detained for 30 hours in
“I don’t want anyone to walk away from my testimony thinking that if only the technology was made more accurate, its problems would be solved,” Williams said in his testimony. “Even if this technology does become accurate at the expense of people like me, I don’t want my daughters’ faces to be part of some government database.”
The disparity in racial and gender accuracy, as well as the invasive nature of the technology, has led to civil rights organizations and politicians calling for bans. The American Civil Liberties Union has called for nationwide bans and is
Civil rights nonprofit Fight for the Future announced that more than 35 other organizations had joined it in demanding that
“This is exactly why we think facial recognition should be banned in public places,” wrote Fight for the Future’s director of campaign and operations Caitlin Seeley George in a press release. “It’s also not hard to imagine what could have happened if police were called to the scene and how they might have acted on this false information.”