Incident Date: July 6, 2010
Prepared By: ONX Service Assurance Centre
HIGH LEVEL EXPLANATION for Power Outage


At approximately 12:45pm on July 6, 2010 power to the ONX data center at Commerce Valley Court, Markham was disrupted. Upon loss of power, ONX confirmed that all 3 generators had started properly. PowerStream was alerted and dispatched a repair team.

At about 1:25 our Generator "C" overheated and shut down. At about 1:40 our Generator "B" also overheated and shut down. ONX Generator Maintenance Company arrived at 1:30 and commenced diagnosis on both systems.

ONX were unable to restart the generators before the UPS batteries were depleted causing loss of power to the data centers.

Generator "B" was restored at approximately 2:25pm. Incoming utility power was restored at approximately 2:37pm and generator "C" was repaired at 4:00pm.

Cause of the Incident:
- A loss of power from the utility combined with overheating of two generators caused loss of power to the data center.

Call to Action
- According to ONX, both generators have been repaired with interim fixes for additional venting to facilitate better cooling. Interim procedures to facilitate air flow have been established.

- According to ONX, A temporary generator is in transit and will be installed July 7th, 2010.