It's been nearly 24 hours since our last event and we're continuing to work with our storage vendor to bring this issue to full resolution.

In the meantime, we feel confident that our emergency changes have helped to temporarily bypass the problem until a permanent fix can be implemented. So we're going to change the status to Online and continue to closely monitor the platform.

Once again, we appreciate your patience and apologize for the trouble this event may have caused you and your end users.

Although we haven't seen the symptoms since 14:22 EST yesterday afternoon, we know that load plays a factor in these events. To help mitigate the effects that load could bring, and reduce the chance of the event recurring, we have worked throughout the night to make preparations to ensure write latency is kept to a minimum and disk writes are able to run as efficiently and quickly as possible during peak load.

Our current focus will be to continue to work with our vendor's Kernel/filesystem experts in identifying and resolving the root cause affecting the storage service.

We sincerely apologize for the inconvenience this issue has caused you and your customers.

Users may experience short periods (less than 10 minutes) where access via POP, IMAP and Webmail is unavailable. We've taken steps to minimize the impact of these periods and to reduce their frequency.

At the same time we are also working on determining the root cause of the issue.

Once again, we're very sorry about the inconvenience to you and your customers.

While ruling out the load balancer update as root cause, we identified some unusual behaviour related to the storage cluster. Our logging has indicated high latency network filesystem writes on the storage cluster that appear to coincide with the intermittent outage events.

As we continue to work toward ruling out the load balancer update as root cause, we're also working in parallel to further investigate and rule out the storage cluster as a contributing factor to the intermittent connectivity issue.

Impact to end user mailboxes is improving, with the 5-10 minute intermittent connection / slowness issues occurring less often. Earlier today, the interval was every 45 minutes, but as of this update, the impact interval is closer to 1H 45M.