Backup Power and Cooling Plans for Critical Facilities
Part 1: How One Hospital Improved Its Emergency Cooling Plan
How One Hospital Improved Its Emergency Cooling Plan
By Dan Koenigshofer - May 2009 - Data Centers
As hospitals expand and upgrade facilities, facility executives should carefully review the capacity of the physical plant’s basic infrastructure. Power and cooling capacity in particular are critical to daily operations. A review of power and cooling systems should include a focus on emergency power planning.
Health care organizations that do not have 100 percent emergency power should have clear procedures in place for the emergency power system. A carefully crafted operational plan for the emergency power system — including the allocation of cooling where most needed — will help ensure consistent, high-quality patient care during power outages.
Few hospitals can provide full cooling when operating on the emergency power system. Hospital management may not recognize how substantial the cooling load is, thinking that, to maintain cooling in critical areas, a few lights can be kept off elsewhere or temperatures might be allowed to rise in non-critical areas. This rarely makes a significant reduction in cooling loads because the largest loads are also the most critical. While full cooling is not required by code, prudent facility executives should consider the following key issues:
- How will the facility provide patient care in the event of a power outage without cooling?
- How much cooling can be provided via the emergency power system?
- If cooling supply is less than the load, which departments will receive cooling?
- Is there a cooling triage plan?
- Who will make these decisions?
In the Real World
A recent power outage at a hospital in central North Carolina demonstrates the importance of an emergency power system operational plan and a cooling triage plan. Prior to the outage, facility staff at the hospital had expected to be able to run one 750-ton chiller on its emergency power system while providing all of the other life safety, critical and equipment loads. Staff tested this during a scheduled outage at 2:00 a.m. on May 2007. Given the loads at that time, the hospital determined that it could actually run two 750-ton chillers and associated pumps.
Three months later, the power went out. The hospital’s emergency power system started normally and began providing life safety, critical and equipment branch power. All the air-handling units started automatically on the equipment branch, but the chillers are started manually. Secondary chilled water pumps are also on the equipment branch.
This outage occurred at about 1 p.m. on a hot, humid weekday. All HVAC controls were set to operate normally, and as secondary loop chilled water temperature rose, all chilled water coils went to the full, open position. Outside air dampers remained in normal positions.
Within about a half an hour, temperature and humidity began to rise noticeably. Soon, condensation formed on walls and floors. At this point, hospital engineers decided to start one of the 750-ton chillers manually. Unfortunately, the estimated cooling load at this time was approximately 2,500 tons. The chilled water temperature continued to rise. After about an hour, the second 750-ton chiller was started. The load on this hot August afternoon was far greater than the load during May’s early morning test, and when the second chiller was started, the in-rush current brought down the entire emergency power system and the 1 million-square-foot hospital went black.
The method for restarting the emergency power system was complex and had not been well documented or communicated to staff, but quick work limited the black-out to approximately 15 minutes, with no adverse impact on patients. Hospital management clearly recognized the need to develop a plan for operating the emergency power system and soon started the process.
Developing a Plan
The first step in developing an operational plan for an emergency power system is to create an accurate one-line diagram of the system. This should not be confused with risers. A one-line diagram should be an accurate depiction of systems, identifying key components and providing a means of troubleshooting them.
Next, do a detailed load analysis to measure actual loads on each automatic transfer switch. This allows for development of a breakdown of the emergency power system load.
Third, create an air handler zoning plan. Determine which areas are served by which air handling units. This information may have changed over the years. Facilities staff may think they are shutting off a non-critical area, only to find that an air handling unit serves a vital space for patient care. The plan should also document the electrical load of each air handling unit. At the North Carolina hospital, nearly half of the emergency power load, not including cooling, was the air handling units.
A written protocol for operation of an emergency power system, along with the one-line diagram and better labeling of panels and distribution switchgear, will make it easier for staff to run the system under all normal circumstances. Clear labeling is important in emergency situations. Use meaningful nomenclature that indicates floor, substation and physical location within the electrical system, including emergency power system branch and panel, and voltage. Be sure panel labels match the one-line diagram.
Cooling Triage Plan
The next step is the most challenging. To prepare a cooling triage plan, hospital management and engineers should work together to determine a sequence of priority for the air-handling unit shutdown. A color-coded sequence may prove helpful. For example, red air handling units would go off and stay off under emergency power, or may not even be connected to the emergency power system. Yellow air handling units would fall in the category of “maybe,” depending on load and circumstances. Green air handling units would receive emergency power and chilled water at all times.
To accomplish the cooling triage plan, various control strategies should be considered. For example, a combination of the following control sequences might accomplish emergency cooling objectives: Raise space setpoints, raise leaving supply air temperature, modulate or close chilled water valves, close outside air dampers, slow air handling units via VFD and completely shut off selected air handling units.
In North Carolina, the hospital’s facility director and consulting engineers began by considering the impact of allowing temperatures in administrative areas to rise significantly. This would reduce the total cooling load by only about 10 percent. In the August outage, the system had the capability of providing only 750 tons of the 2,500-ton load (30 percent). In reviewing options for the control sequence, the team opted to completely shut off selected air handling units. In all other scenarios, the outside air intake would quickly result in unacceptable temperature and humidity conditions with no chilled water available. It was also deemed necessary to maintain the operation of all exhaust fans, necessitating intake of outside air.
In addition, the hospital decided that, at least in the beginning, the system would be implemented manually by the building automation system (BAS) operator. Shutting off air handling units effectively closes a space for occupancy. Many variables make it imperative to have human intervention, including time of day, case load and type, scheduled surgeries and outpatient procedures, how long the utility thinks the outage will last, and weather. Another reason the shutdown sequence was not programmed was concern that, if an automated shutdown sequence started, there would be no way to modify it to take into account seasonal variations, for example. With a written, but manual, shutdown sequence, the operator can get input from other sources and alter the sequence. If the operator is unable to get any input, there is a written standard operating procedure to follow.
While exact loads depend greatly on the time of day, day of the week, and outside weather, estimates show that the facility can run without cooling for approximately 30 minutes. After that time, the first 750-ton chiller would be started manually. If the outage persists for a total of 60 to 90 minutes in the summer, a second chiller would be needed. To start the second chiller, some or all of the air handling units would have to be shut down. After the second chiller is started, there would be 1,500 tons available to the high-priority “green” air handling units. The maximum load on the “green” air handling units is 851 tons. During a prolonged outage, a BAS operator would be able to turn the middle-priority “yellow” air handling units back on one at a time while keeping a close watch on the total emergency power system load.
By carefully assessing an emergency power system and developing a priority list for department operation, facilities staff and engineers can develop a clear plan to allocate available cooling in the event of a prolonged power outage. Ultimately, if decisions regarding the cooling triage prove too difficult in terms of which facilities and operations will receive emergency power and which facilities won’t, that’s a sign that more comprehensive emergency power upgrades may be in order.