Misunderstanding Triggered Police Response at Kenwood High School

A significant incident occurred at Kenwood High School in Essex, Maryland, last week when police responded to a false alarm involving a 16-year-old student. The alarm was triggered by an artificial intelligence (AI) gun detection system that erroneously identified a bag of potato chips as a firearm.

Taki Allen, the student involved, had an empty chip bag in his pocket while he waited for his ride. Suddenly, police surrounded him, ordering him to the ground and placing him in handcuffs, according to local reports.

Body camera footage from officers revealed their realization that the AI system, which monitors real-time footage, had mistakenly flagged the chip bag as a potential weapon. “I was just standing there, and all these police cars arrived with guns drawn. I had my hands up, confused about what was happening,” Allen recalled.

Once the officers reviewed the flagged footage, they searched a nearby dumpster and found that the supposed weapon was indeed just a chip bag. “It looks like a bag of chips, not a gun,” one officer mentioned, suggesting that AI isn’t infallible.

The incident on October 20 raised concerns among students, school officials, and the community about the reliability of such systems. During a conference call, Superintendent Dr. Miriam Rogers reported that the alert had been called off, but the school principal, who hadn’t seen the alert cancellation, initiated a police response anyway.

Rogers explained to WMAR-2 that the AI program was designed to issue alerts based on human verification, which was how it functioned in this case. “The system did its job by prompting a human review for any immediate danger,” she clarified.

Omnirat, the company behind the AI system, stated that it combines AI detection with human validation to ensure proper responses to potential threats. “Our design called for escalation to a human for final assessment,” a representative said.

While the technology worked as intended, Allen expressed discomfort following the ordeal. He mentioned feeling unsafe outdoors after the incident and believed such a misunderstanding should never have occurred. “How can you confuse a chip bag with a gun?” he wondered. He added that he prefers staying indoors until his ride arrives, feeling too anxious to even snack outside.