Status archive for June, 2010
Email Cluster A is In Maintenance
We have scheduled a four hour network maintenance window for OpenSRS Email Services - Cluster A starting now (05:00 UTC). During this time, we will be updating our calendar services.
Service Impact:
OpenSRS Email Services - Cluster A will be available during the 4-hour window except calendar services. All mailbox access (IMAP, POP, SMTP, Webmail) and provisioning via the Mail Administration Center (MAC) will remain fully online.
Impact for Resellers:
Calendar services will be unavailable for the duration of the window. All other Open SRS Email Services will remain available.
Impact for End-users:
Calendar services will be unavailable for the duration of the window. All other Open SRS Email Services will remain available. Calendar functionality will remain unchanged. This is an infrastructure change only.
.de is Online
The .de maintenance is complete.
.de is In Maintenance
The .de Registry has a scheduled maintenance period at this time. .de services are unavailable. The Registry advises that the maintenance will be complete at 16:00 UTC.
.de domains continue to resolve.
Trust Service is Online
All OpenSRS SSL services are fully online.
Update: June 22, 2010: 16:16ET/20:13 UTC
Incident Summary:
Summary: A Database unit suffered a memory corruption resulting in a kernel panic. This caused OpenSRS SSL Services to be offline. We addressed the issue, restarted services, and tested. All services were fully available within the hour. We moved the database to a stand-by platform while the hardware problems on the original system are resolved.
Monday, June 21, 2010 19:20 ET/23:20 UTC
Our Network Monitoring system alerted of an issue with a core database unit. OpenSRS Domains, SSL and Storefront services were unavailable.
19:25 ET/23:25 UTC
Technical teams were engaged and identified the issue. A database unit suffered a hardware failure. OpenSRS services were restarted and teams began testing.
19:51 ET/23:51 UTC
Services were available. We changed the status to degraded while we continued to closely monitor availability and continue our testing regime.
20:02 ET/Tuesday, June 22, 2010 00:02 UTC
Services were working well.
20:20 ET/Tuesday, June 22, 2010 00:20 UTC
All OpenSRS services were online.
This update is related to Incident 13107
Storefront is Online
All OpenSRS Storefront services are fully online.
Update: June 22, 2010: 16:16ET/20:13 UTC
Incident Summary:
Summary: A Database unit suffered a memory corruption resulting in a kernel panic. This caused OpenSRS Storefront Services to be offline. We addressed the issue, restarted services, and tested. All services were fully available within the hour. We moved the database to a stand-by platform while the hardware problems on the original system are resolved.
Monday, June 21, 2010 19:20 ET/23:20 UTC
Our Network Monitoring system alerted of an issue with a core database unit. OpenSRS Domains, SSL and Storefront services were unavailable.
19:25 ET/23:25 UTC
Technical teams were engaged and identified the issue. A database unit suffered a hardware failure. OpenSRS services were restarted and teams began testing.
19:51 ET/23:51 UTC
Services were available. We changed the status to degraded while we continued to closely monitor availability and continue our testing regime.
20:02 ET/Tuesday, June 22, 2010 00:02 UTC
Services were working well.
20:20 ET/Tuesday, June 22, 2010 00:20 UTC
All OpenSRS services were online.
This update is related to Incident 13107
Domain Service is Online
All OpenSRS Domains services are fully online.
Update: June 22, 2010: 16:16ET/20:13 UTC
Incident Summary:
Summary: A Database unit suffered a memory corruption resulting in a kernel panic. This caused OpenSRS Services to be offline (Domains, SSL and Storefront). We addressed the issue, restarted services, and tested. All services were fully available within the hour. We moved the database to a stand-by platform while the hardware problems on the original system are resolved.
Monday, June 21, 2010 19:20 ET/23:20 UTC
Our Network Monitoring system alerted of an issue with a core database unit. OpenSRS Domains, SSL and Storefront services were unavailable.
19:25 ET/23:25 UTC
Technical teams were engaged and identified the issue. A database unit suffered a hardware failure. OpenSRS services were restarted and teams began testing.
19:51 ET/23:51 UTC
Services were available. We changed the status to degraded while we continued to closely monitor availability and continue our testing regime.
20:02 ET/Tuesday, June 22, 2010 00:02 UTC
Services were working well.
20:20 ET/Tuesday, June 22, 2010 00:20 UTC
All OpenSRS services were online.
This update is related to Incident 13107
Storefront is Degraded
OpenSRS Storefront services are online. We continue to closely monitor and test services while we investigate the cause.
This update is related to Incident 13107
Trust Service is Degraded
OpenSRS SSL services are online. We continue to closely monitor and test services while we investigate the cause.
This update is related to Incident 13107
Domain Service is Degraded
OpenSRS Domains services are online. We continue to closely monitor and test services while we investigate the cause.
Update Tuesday 00:02 UTC
All services are working well. Our technical teams are testing functionality. We will continue to keep services in degraded status as a precaution.
This update is related to Incident 13107
Trust Service is Offline
We are investigating a database issue. At this time, OpenSRS SSL services are unavailable. Our Technical teams are engaged and investigating. We will have more details shortly.
Update 23:35 UTC:
We restarted services and are testing.
This update is related to Incident 13107