I can't help but chuckle at a writer using the term "insanely great" to describe the building. It lacks a certain potency in the context of a book's tagline! Perhaps it's a symptom of the exagerated language pop culture uses for average things diluting the power of other possible words.
All drives broken at the very least, a 10k rpm drive doesn't like ordinary vibrations already, much less 40cm+ displacement in a fraction of a second.
Heavy servers and especially UPS battery rows would likely take the whole rack down/toppling over with them. Plus: most cabling is secured to the walls/floors with not very much slack, which means a LOT of damaged/torn cables and FUBAR'd ports.
All in all, if an earthquake of the scale in the video would hit a typical European DC, it's bye-bye and rebuild.
Which gets you into that boring part of actuary calculations. In seismically inactive parts, "bye-bye and rebuild (while the cluster is running from a geographically remote datacenter, and only a slight increase in latency indicates this)" could be an order of magnitude cheaper, and thus preferable. In other words, downtime is not replaceable, hardware is.
Just guessing, but situations like these might be the place where it will make sense first to use server-side SSDs. While probably not there yet, it makes sense as the gap narrows that some day the cost of using SSDs is cheaper than building a whole floating/moving floor.
The SSDs address part of the problem. As noted by another post here, many rooms are build and structured with the assumption that nothing ever moves, so rather reasonably, you lay cable in a manner that has little flexibility, you mount things to floors/walls, and so on.
The data integrity is important, but the physical design and layout makes a rather big assumption that the infrastructure you're mounting stuff on will not move or vibrate.
Plus the DC itself might be running, but now you could be running it on a generator (no outside power); better hope you can get a fuel truck to it before the 1-week tank runs out (are there truckable roads outside now?). And connectivity - you might have line slack inside your building, but the fiber cables might be broken in several locations before they even get to next active element (which is also earthquake-proofed? And powered? For how long?); so perhaps you're down to the radio fallback (hope the antennas aren't misaligned too much, let alone that their masts are still upright); again, assuming that the other end of the link is operable.
In other words, preparing for vis major is far harder than it looks. Doable? Yes, if you're willing to go all the way to military-grade resilient comms...for a military-grade budget. Far easier to failover to a DC in a different zone.
Forgive my uninformed question but I remember seeing a video many years ago where a (Samsung?) hard-drive had built-in protection from being dropped. The disk will stop spinning within a millisecond when it detects movement. They could survive a sudden drop onto a floor. I assumed this was a common feature of modern disk based hard-drives.
Could built-in protections like this in harddrives be a sufficient protection in an earthquake? What other moving parts are that at risk here? Assuming the servers themselves are locked in cages, I wouldn't expect them to crash to the floor.
Although the big difference here is it's not a sudden drop but a prolonged forceful shaking.
That keeps your data safe, but (and I'm guessing here) quite plausibly means filesystem writes may likely start failing, causing services on the affected server to start failing. If you need uptime during an earthquake, then that's not sufficient.
"When the computer is stable, the drive operates normally again."
So unless you install a drive that has its own motion detection on board the computer will simply quickly 'park' the drive and will allow it to resume operation without any issues when it has landed.
to be fair, AlephGarden did say during an earthquake. Telecoms, Hospitals, etc, perhaps wouldn't be happy with being out for the time taken for an earthquake to blow over. Plus aftershocks when damage control is in progress.
I used it to add X11 autorotation to an X61 tablet. No spin animation, but it was a cool one-day hack nonetheless.
The fun part was that the orientation analyses was done from a shell script, and actually worked 100% of the time (unlike so many phones)! \o/
The insane part was that DRM/KMS on Linux is 1000% crazy and I had to patch the kernel to stop poking the backlight on every. rotation. event, grr. (I had to do it in the kernel - I basically killed DPMS - because X11 libdrm is utterly incomprehensible.)
These were fun, but if i remember rightly, Apple have largely phased the Sudden Motion Sensor out on all their laptop models that come SSD only, which is increasingly almost all of them. There were some ridiculous examples of using it to sort mail into folders in mail.app as well, by tilting the MacBook left and right.
A typical accelerometer can detect free falling and the hard drive can spin down before it hits the ground. I guess in that sense being shaken is worse than being dropped "suddenly".
> All drives broken at the very least, a 10k rpm drive doesn't like ordinary vibrations already, much less 40cm+ displacement in a fraction of a second.
Do commercial server drives not have the same anti-shock tech as laptop drives?
Drops are easier because there's a gap of free fall before the actual hit so there's time to sense and park the heads. Earthquakes are more instantaneous where the shaking is the first warning the protection can react to.
I remember us having some server issues a few years back when they were blowing up rocks for the foundation for a new mall a few 100 meters away in Stockholm. You never know.
I remember reading on http://reddit.com/r/talesfromtechsupport some time ago (I unfortunately don't remember what thread) about someone who decided to move their server rack. Said rack had a UPS, but no wheels.
The 10k HDDs in the blades didn't really like it...
This feature is built into a lot of critical infra there, like airports. As I'm sure you know, the more common (and costly) it is, the better investment it is.
I visited a couple of DCs in Tokyo, and the tours systematically feature a look at the anti-seismic system. It's actually pretty unimpressive : basically the seismic-protected part of the building is mounted on big rubber dampers, with some huge pistons thrown in for active attenuation. In taller buildings (I visited a DC with around 20 stories IIRC) the stories are not rigidly connected together, so that instead of swaying (and possibly toppling) during an earthquake, the building just kind of wobbles.
Very effective though, as the video shows. My visits were post-2011, and each DC had a record of the building's movement during the big earthquake; max amplitude on the seismic-protected part was a couple of centimeters, vs 50 cms or more for the rest of the building.
> In taller buildings (I visited a DC with around 20 stories IIRC) the stories are not rigidly connected together, so that instead of swaying (and possibly toppling) during an earthquake, the building just kind of wobbles.
This is the reason why Japanese pagodas have survived for so long.
Just to clarify: I meant that the equipment itself is unimpressive (mundane would be a better term I guess) but the results are definitely impressive :D
I've been in a datacenter in Tokyo where the floors were not seismically isolated, but the rack cabinets were made to sway. It's hard to tell many floors up that an earthquake is in progress, but you can see it when you see the racks swaying!
I visited the Dreamworks DC in SOCAL back in 2005 and they had per rack isolation plates as you remember. They also had a 25' long tape drive on one huge isolation plate. Those plates basically are on a central piston and rotate in a circular pattern. Seems a lot cheaper than proofing the entire floor.
I wonder if it is disorienting standing or walking on the movement isolating floor.
There's a (thought?) experiment you can do where you put someone inside a fake room built like an overturned box, and then jerk the walls in a random direction while the floor stay still. You get disoriented and fall over. Or the more common experience where you're on a stopped train and the train next to you starts to move, and it takes you a minute to figure out which of you is actually moving.
I'd have to imagine standing on the isolated floor while the rest of the building moves would be similarly confusing.
or like the spinning tunnel effect, where the walls are spinning around you and you have difficulty walking straight because your brain thinks you're falling over
Category "Auto and Vehicles" ? It is interesting to note that the people on the seismically isolated floor are not swaying with the video (it is explained that the camera is mounted to the non-isolated part of the building so it appears the server room floor is moving when instead it is the building that is moving).
Most of the data centers I've looked at in the Bay Area just bolt the racks to the floor and are done with it assuming, I presume, that it is the shifting on the floor that damages the hardware.
The duration and intensity of an Earthquake are strongly correlated. You can even use it to estimate how strong a quake is and how far away you might be.
The Sendai earthquake in 2011 was 6 minutes long. There's a story which I now cannot find about a seismic conference being held in Japan some distance from the epicenter. They felt only moderate shaking, but were immediately aware of the severity of the quake due to the duration.
There are an astoundingly high number of quakes in Japan that are strong enough that you can feel. When I was in Tokyo years ago, I felt one every four weeks on average.
You quickly come to a different relationship with the world when it refuses to stay still that often.
Commercial racks and datacenter products have optional features that can be utilised in earthquake prone environments. What you see in the video is not only those rack features but also structure of the building itself (both are important and neither one is sufficient for certain areas).
I guess a similar level of movement isolation would probably be required for all those repurposed oil rigs and maritime-oriented machine rooms that anticipate taking advatage of sea water as server coolant.
I wish I had this video during my infosec & HA consulting days.