Author Topic: ***Possible outage today***  (Read 519 times)

December 22, 2012, 11:31:31 AM
There may be some outages today. It's not a server or web issue, but a significant power issue on the national grid up in Scotland, which is being worked on as we speak. The data centre is currently running on partial backup battery/generator power, and experiencing power spikes, which could damage data. As a precaution, they may have to disconnect the data centre, until the power spikes settle down, and the fault is fixed. I have a full backup stored here, which is only a few hours old. So if the worst comes to the worst, we will only loose a few hours of posts etc ;-)

December 22, 2012, 11:46:58 AM
Reply #1
  • Global Moderator
  • Insane tog
  • *****
  • Posts: 27576
  • Location: Nottingham UK
Any idea of the cause Chris?   Wouldn't surprise me if it's not something to do with the weather.
A 'Veteran' -- whether active duty, discharged, retired, or reserve -- is someone who, at one point in his life, wrote a blank check made payable to his country for an amount of 'up to, and including his life.'

December 22, 2012, 12:10:29 PM
Reply #2
Could be just weather Bob, but there were also reports of outages all last week in Fife (where data centre is), due to a car crash damaging some kind of main sub station or summat. National Grid were said to be working on it right up until Tuesday. So it may just be an issue with what they have done. For them to be looking at a possible data centre closure/disconnection from the grid, I would think the power spikes were extremely bad. From what I can guess from the email I got, they are using grid to keep the batteries charged, so the batteries are acting as a kind of buffer between grid and the data centre :o

December 22, 2012, 12:48:03 PM
Reply #3
  • Global Moderator
  • Insane tog
  • *****
  • Posts: 19010
  • Location: Lincolnshire UK
Knowing how sensitive electronics are to power surges/spikes ec. surely they have some sort of power stabilisation on their inputs to the servers.

December 22, 2012, 06:25:56 PM
Reply #4
Yes m8, they have all kinds of systems in place. But it seems the spikes were way above those you would normally expect, hence they disconnected from the main grid, and used the UPS/CPS system to act as a main buffer between grid and data centre. Chances of a spike making it past the usual protection, is VERY slim. But when you are talking about 100's of servers, containing 10,000's of websites, even a VERY slim chance, is a chance too much ;)