On Thursday, November 29, 2018 Republic Wireless experienced an outage impacting calling, messaging, and voicemail.
During the outage, some members asked what caused the outage. It’s a good question, and we’d like to provide some insight about what we experienced.
Republic Wireless partners with industry leaders to efficiently make use of existing infrastructures and resources for many of our services. An obvious example is that we don’t build our own cell towers across America; we contract with two major carriers to provide cellular service. Another easy-to-understand example is this Member Community. We didn’t build our own forum software from scratch; we contract with an excellent forum software company and they provide the platform and support to keep our Member Community running. The service outage yesterday occurred when a data center we partner with experienced a disruption so unusually severe that it impacted even our backup and failover systems. As the data center recovered, there were ripple effects across our systems that our engineers worked on throughout the evening and monitored closely into the night.
While our engineers continue their work to ensure stability across our service, there is also much that will be done to study yesterday’s events and look for ways to avoid or minimize the risk of recurrence.
As we are seeing some concern from our members about the idea of a disruption at a data center, our leadership team has asked me to clarify that there was no data breach during this outage.