For decades, one measure has dominated the conversation about ambulance system performance: response time.
How quickly did the ambulance arrive? Did it meet the eight-minute standard? What percentage of calls were “in compliance”?
But as EMS has evolved, the question is becoming much broader: How do we actually know whether an EMS system is performing well?
That was the focus of AIMHI’s recent webinar, “Beyond response times: Redefining what great EMS looks like,” built around findings from AIMHI’s latest benchmarking work. The discussion brought together Johna Easley of Emergency Medical Services Authority in Oklahoma, John “JP” Peterson of Mecklenburg EMS Agency, Jonathan Washko of Northwell Health Center for Emergency Medical Services, Thomas Wieczorek of the Center for Public Safety Management/ICMA, and AIMHI President Rob Lawrence.
The starting point was deliberately provocative. Traditional EMS scorecards tend to count response times, transports and ambulances on the street. Those measures tell communities what EMS did, but not necessarily what EMS accomplished. Modern EMS is increasingly expected to demonstrate clinical outcomes, patient experience, safety, efficiency, financial sustainability and value.
| MORE: It’s time to redefine what great EMS looks like
There is no single model for great EMS
The benchmark’s first major finding was that organizational structure alone does not determine performance. Participating agencies range from public utility models, local government systems, health-system EMS and franchise operations.
What appears to matter more is how the system is led, managed and held accountable.
Panelists repeatedly returned to data, clinical governance, organizational values and transparency. Peterson described the importance of a mission centered on patient care, coupled with accountability and continuous review of performance. Lawrence described data as little more than a “box of numbers” until it is turned into intelligence through a cycle of collecting, collating, analyzing and, most importantly, acting on it.
The stopwatch is losing its monopoly
Perhaps the clearest challenge to traditional EMS thinking came from the response data itself.
Across benchmark participants, only 37.3% of responses received a lights-and-siren response, while just 6.9% of transports were conducted hot. The underlying principle is straightforward: high performance increasingly means getting the right resource to the right patient at the right time — not getting every resource everywhere as fast as possible.
Peterson explained how MEDIC has moved to differentiated response standards based on clinical acuity, including longer response windows for carefully selected lower-acuity patients. The agency uses dispatch data to identify which call types are actually associated with potentially lifesaving interventions.
After approximately three years, Peterson said MEDIC had identified no negative clinical outcomes attributable to the tiered response approach. The change has also helped protect advanced resources for patients who genuinely need them.
Start the clock when the patient does
The webinar also questioned how response time itself is calculated.
For the patient, the emergency does not begin when an ambulance starts driving. It begins when someone calls 911. Call-answer time, processing, activation and travel all contribute to the patient’s experience.
As the presentation put it, patients do not distinguish between the 911 center, dispatcher, first responder and ambulance. They simply know when they called for help.
That does not make response time irrelevant. Cardiac arrest, STEMI, stroke, major trauma and other time-critical emergencies clearly require rapid intervention. But the panel argued that the goal should be a clinically appropriate system response, rather than a universal stopwatch applied identically to every patient.
Measure what happens to patients
AIMHI’s fourth finding moves the scorecard from activity toward outcomes.
The new measures include clinical outcomes, patient experience, safety, efficiency, financial sustainability and value. Half of the benchmark participants were involved in clinical research trials, with 29 IRB studies undertaken during the previous two years. Participating agencies also reported extensive use of clinical dashboards, with 80% measuring patient experience through an outside organization.
That patient perspective matters. Technical clinical excellence is essential, but patients also remember whether someone explained what was happening, treated them with dignity and showed compassion during an exceptionally stressful moment.
Great EMS must also be sustainable
Finally, high performance has to be financially sustainable.
The benchmark reported a median expense per transport of $639 for AIMHI member agencies, compared with median revenue per transport of $523. The presentation therefore posed a larger policy question: if communities expect EMS systems to maintain readiness, who should pay for that capacity — patients, insurers, government programs, hospitals, taxpayers or some combination?
The webinar ultimately left communities with five questions: Are we measuring outcomes rather than simply activity? Are resources matched to patient need? Are workforce and operating models sustainable? Do we understand what EMS costs and who pays for it? And can we demonstrate improvement against comparable systems?
That may be the clearest definition of where EMS performance measurement is heading.
Great EMS is not defined by a stopwatch, an organizational chart or the number of ambulances in the garage. It is defined by measurable outcomes, disciplined leadership, responsible stewardship, continuous improvement and the value delivered to patients and communities.
About AIMHI
The Academy of International Mobile Healthcare Integration (AIMHI) represents high-performance and high-value EMS and mobile healthcare systems committed to advancing clinical excellence, operational efficiency, accountability, research, innovation and the continued evolution of EMS. AIMHI members share data, experience and best practices to help improve patient care, strengthen system performance and demonstrate the value EMS brings to the communities it serves.
Additional resources
- Presentation slide deck: Beyond response times – Redefining what great EMS looks like
- Watch the webinar: AIMHI webinar – Redefining what great EMS looks like