[ID Server] Shared/Reseller hosting database corruption - 28 July 2015

  • July 29, 2015 by Tech #1

Dear Clients,

We are truly sorry for the inconvenience caused. In our company principle, we will not hide any issues to cover/protect ourselves. At 10.30 PM, we got a notification that a server was down. Immediate check was done with the datacenter and it was a determined to be power loss and immediate reboot was done to the server. Unfortunately, we have tried multiple time to recover the database but the innoDB keep throwing error of corruption. I'm truly sorry for this event, which has occurred previously as the issue was the failed power outlet in the rack. This was taken care last time, but strangely the issue occurred again. We have put the server power outlet to the main power source to prevent such issue.

In the event that we completely not able to bring up, we have no choice but to restore from our backup on 28th July 8PM.

Please accept our sincere apologize for this event as we have tried all we have to salvage the loss. And if you are having issue at your site, please open a ticket to support@sosys.net. If you have newer backup, please let us know and we will restore it.

Kind Regards,

SOSYS.NET


==========================

28 July 2015 - 10.30PM - Server down detected

28 July 2015 - 11.15PM - Server is up

28 July 2015 - 11.20PM - DB crash detected, multiple attempt to force innodb recovery failed

29 July 2015 - 0200AM - Reinstall DB server and restore from backup as of 8PM 28 July.

29 July 2015 - 0300AM - Restore started and completed at 04.30AM