Aftermath server migration part 3

29/10/2009 19:09

Here follows a translation of the excerpt of I3D's statement which we received.

In the night of Tuesday to Wednesday all servers have been moved to a different location. Because of fear to have the equipment hijacked by WeDare (building owner) we did not announce the move.

During the move our trucks were blocked and the police had to be involved. This event delayed the move for 3 hours. Since 20 people were working on the move, we lost 60 hours of work.

Durig the day all servers were racked and we could begin cableing and booting the +3000 servers.
Unfortunately we discovered routing problems since We Dare were still announcing the IP blocks.
All issues have been resolved in the meantime.

While the above is part of the official statements, I have been on the telephone multiple times. The server was again running last night, however network connections and cable issues were cause of the servers not being reachable for quite some time.

Today 29-10-2009 at 1800 hrs, finally, the websites were reachable again.
We have suffered from 40 hours of unannounced downtime which is obviously unacceptable and can kill anyones online business.

For a small company as I have, iziCompany, it is not so easy to move servers around. However a solution as Failover is an option to have websites reachable, even if one server is down.

In the coming weeks I will try to make the necessary investments to get this done after carefully investigating proper datacenters available in The Netherlands.

A sincere apology is in place. Please create a ticket if you experience trouble as databases may be affected with the powerdown.
Off-location backups are in place on the backup server and I can do the restores when needed.

<< Back

View RSS Feed