Hell of a day
It began at 0900 with an urgent request for action one of the company's servers, it finished at 1810 feeling utterly knackered and frustrated.
Luckily, the server bit went easily and was complete at 0915.
At around 1000 we received reports that the Internet was down and that our phone lines had gone the same way.
To cut a long story short, our ADSL connection was hit by a rather large scale BT outage. This triggered a DNS bug in Asterisk that prevented anything speaking SIP from, well, speaking.
We got the phone system back online around 1600 having performed ridiculous amounts of packet sniffing, restarts and configuration tweaks on the phone server. The ADSL was switched to our backup account when news came in that BT may not have lines reconnected until at least 2nd April. That's one big outage.
As of right now we're limited in what we can do - many of our operations are bound to our normal ISP for security reasons and moving everything to our backup connection is not trivial. Still, phones and web are back.
Recent Posts
- Ubuntu shell login bug solved
- Mac OS X, DHCP and unroutable subnets
- Amazon: No UK Datacenter planned
- ASUS AI Recovery Exception Error Solved
- Early Message Queue Experiences
Recent Comments
- Stefan on ASUS AI Recovery Exception Error Solved
- Anderson on ASUS AI Recovery Exception Error Solved
- jmkg on Installing ActiveMQ on Ubuntu
- Donna on Installing ActiveMQ on Ubuntu
- Martin S on Installing ActiveMQ on Ubuntu
Pages
- @mojavelinux correct. Eclipse supports it but not Netbeans. Most annoying.
- Maven on windows downloading dependencies from nexus. Stalls repeatedly at cmd prompt and from Netbeans. #sucks
- @tsohost we switched to magrathea due to reliability issues with gradwell. Have had no complaints since and are cheaper.
- @mairin bbc broadcasts not paid for by state. License fee is very different.
- @tsohost gradwell, I assume?
- Why won't @BT_UK let me paste a complicated new password into their account reset screen? Must type in a simpler one instead. #insecure
- Amazing how fast new dell tool-less rack mounts go in compared to old types needing to be measured and screwed on.
- 1100 lines in a php class, 11 static, 24 public and 0 private/protected methods. Argh! Where's @unclebobmartin when you need him...
- @simonbrown @palmerj3 @jitterted software is like a road. Travel along it for the most reliable current documentation. A map is a quick ref.
- @simonbrown @palmerj3 @jitterted I think you mean the code mustn't be the *only* documentation..?
Flickr Photos
|
