Thu, 6 Mar 2025 23:19 pm UTC:
The Hamilton site staff were working with suppliers on their UPS units. We have been advised that should have been non-disruptive. While switching to bypass mode, fuses tripped, resulting in all our services at the site loosing power unexpectedly.

Our team responded within minutes of the first alarm. And once power was restored we completed repairs to networking equipment and verified services were all working correctly.

We are continuing to look at options to improve service stability. The UPS vendor is investigating and we expect details from that in the following week.

A report will be available on request, after our team has received and reviewed all the information.

Thu, 6 Mar 2025 22:34 pm UTC: The DNS resolution issue has cleared.

Thu, 6 Mar 2025 21:30 pm UTC: An issue with DNS resolution is being worked through by our networking team.

Wed, 5 Mar 2025 23:53 pm UTC: Alarms are cleared. We will be following up with our vendors to resolve outlying issues and better understand what happened, Meantime all services should be back in normal operation.

Wed, 5 Mar 2025 22:50 pm UTC: Site is back on utility power. Additional services are coming back.

Wed, 5 Mar 2025 22:00 pm UTC: Site power was affected by a UPS issue. We are working with our vendor to complete restoration of services. Selected network equipment has been restarted out of an abundance of caution, to make sure they are operating normally. Some services have been restored already.

Wed, 5 Mar 2025 21:41 pm UTC: A power issue has been identified.

Wed, 5 Mar 2025 21:30 pm UTC: We have identified a router that is not be forwarding traffic correctly. A team member is heading to site to take recomended actions, a further update is expected ~15-20 minutes

We are currently seeing severe packet loss to our Hamilton site. This is being actively investigated.