The computer systems that connect 911 callers to Los Angeles Fire Department rescuers broke down repeatedly last month, complicating and delaying emergency responses and prompting renewed calls to fix the agency’s faulty technology.
Key parts of the decades-old system that the department relies on to process emergency calls and automatically send rescuers failed five times in July, according to city officials.
Together, the outages totaled more than 12 hours of disruption in normal operations and forced dispatchers to use radios to assign rescuers to emergencies and manually track the availability and location of units, sometimes using golf tees and pegboards.
The problems delayed a small number of calls for several minutes, fire officials said. They said they knew of no “adverse” outcomes, but a full investigation of the effects of the outages hasn’t been conducted.
Last year, a Times review linked similar breakdowns with slow responses to four serious emergencies, including a South Los Angeles structure fire in which two people died.
This week, officials blamed four of the outages, which began July 5, on a computer software glitch in the database at the heart of the agency’s 911 call center. A fifth crash caused malfunctions in an alarm system that alerts rescuers at the Fire Department’s 106 stations. The software bug has been corrected, officials said, but they acknowledged that more crashes could occur.
“Confidence is one of those things. You feel confident until something happens, and you say, ‘Oh, boy,’” Ted Ross, a top official with the city’s technology agency, recently told a City Council committee. “We’re taking proactive steps to prevent this from happening in the future.”
The recurring problems underscore a challenge faced by Mayor Eric Garcetti, who has said an upgrade to the LAFD’s technology is a priority for his administration. Members of the city Fire Commission, the L.A. County Civil Grand Jury and the City Council have also called for a sweeping overhaul of the department’s computer systems.
“Our general dispatch system, both in the human architecture, the technological architecture and the systems themselves, needs a serious upgrade,” Garcetti said in an interview last week.
The outgoing commander of the LAFD’s dispatch center has said the 911 computer system crashes are preventing the department from safely making cost-cutting changes. Last year, Fire Chief Brian Cummings proposed saving more than $3 million each year by switching dispatchers to eight-hour workdays and reducing the number of dispatchers standing by at the call center in downtown Los Angeles.
LAFD dispatchers are full-fledged firefighters who work 24-hour shifts about 10 days a month. While on the clock they take turns answering phones, training and sleeping. The work schedule means that in the event of a system crash or major emergency, 26 firefighters and three captains are quickly available to handle calls.
“We have a whole system of systems, and anything can break it down,” Assistant Chief Daniel McCarthy said after a meeting of the Fire Commission on Tuesday. “If we had [fewer] guys there it would have been tragedy. There would have been death and destruction.”
Expensive technology upgrades are in the works, but officials say it will take years to complete the changes. The pending improvements include installation of real-time GPS tracking devices on rescue vehicles, the replacement of the faulty 911 dispatch database and fixes to the fire station alarm system.
The department recently contracted with an outside consultant to review the various computer systems and develop a long-term improvement plan.
Cummings told fire commissioners Tuesday that it was important to let the consultants complete their work. “We’re slowing the process down,” he said.
Garcetti is pressing to improve a wide range of city services by using technology more effectively.
The chief has struggled to restore confidence in his management of the 3,500-employee agency since fire officials admitted last year that they had overstated response times, making it appear that rescuers arrived faster than they actually had.
Times investigations have found delays in processing 911 calls and summoning the nearest medical rescuers from other jurisdictions, as well as wide gaps in response times in different parts of the city.
Even when department systems are operating properly, city dispatchers take far longer than the national standard to send rescuers, according to a Times analysis of hundreds of thousands of calls handled over five years. Those findings were later confirmed in reports by the city controller and an LAFD task force.
Times staff writer Michael Finnegan contributed to this report.