Trending Topics

GAO: AI-generated attack plans raise preparedness questions for first responders

Senator plans January hearing after watchdog testing found four major chatbots generated plans for mass-casualty and grid attacks

GAO_ AI-generated attack plans raise preparedness questions for responders.jpg

Covert test results show the extent to which popular generative AI platforms produced attack information.

Source: GAO

WASHINGTON — Government investigators say four widely used AI platforms produced plans for terrorist attacks in the U.S. when prompted during covert testing, prompting the incoming chair of the Senate Homeland Security Committee to schedule a hearing on AI safety, the Associated Press reported.

A Government Accountability Office report (below) released on Nov. 18 found that ChatGPT, Claude, Gemini and Grok each generated attack plans in under 12 hours. Two platforms produced plans involving an improvised explosive device meant to cause mass casualties.

The other two produced plans targeting the electrical grid. Investigators said the platforms initially refused some requests but that testers were able to get around the safeguards.

Anthropic said it takes the findings seriously and does not dispute that a determined tester can extract harmful content by misrepresenting a request’s purpose, but said it could not verify GAO’s results, according to the Associated Press. Google said the testing used earlier models. OpenAI said it welcomed the chance to respond, and SpaceXAI said it continues to work on safety with each release.

What does this mean for first responders?

IED attacks and attacks on critical infrastructure are scenarios fire and EMS agencies already train for. The question is whether planning barriers for bad actors are getting lower, which makes existing preparedness priorities more relevant: mass casualty triage and transport, awareness of secondary devices, scene safety, unified command with law enforcement, and operating through extended power disruptions. Consider training with your personnel on the following subjects:

Sen. Maggie Hassan, D-N.H., who will chair the committee, has said AI risks will be the subject of one of her first hearings when the new Congress convenes in January. EMS1 will track whether any resulting recommendations touch emergency response. In the meantime, the GAO’s findings don’t change what crews are asked to do on scene. They are a reminder that the fundamentals, including triage, scene safety, unified command and operating through disruptions, need regular practice.

Trending
Crews drilling 150 feet down at Chiquita Canyon Landfill hit trapped gas and decomposing garbage
Lynnfield fire chief Glenn Davis told the Select Board a "$0 bid” private ambulance would mean one dedicated ALS unit, lost EMS revenue and a decision the town cannot undo
Othmane El Omari alleges he was suspended and then fired for refusing to shave a beard required by his Muslim faith
Goffstown, Dunbarton, New Boston and Weare will use a $75,000 grant to study a regional EMS transport model

Bill Carey is the associate editor for FireRescue1.com and EMS1.com. A former Maryland volunteer firefighter, sergeant, and lieutenant, Bill has written for several fire service publications and platforms. His work on firefighter behavioral health garnered a 2014 Neal Award nomination. His ongoing research and writings about line-of-duty death data is frequently cited in articles, presentations, and trainings. Have a news tip? He can be reached at news@lexipol.com.