Latency
The beatings will continue…
by Jesse on Oct.23, 2007, under Data Migration, DataCenter Move, General, Latency, Replication
…Until morale improves.
Trying to run 4, FCIP trunks over a half a DS3 is a lot like raising a teenager.
Sometimes it looks like it’s working, but in reality it’s just screwing around playing video games.
Actually, my favorite is that “Raising a teenager is like trying to nail JELL-O to a tree” I’m feeling about the same level of frustration.
What’s basically happening is that the link is fine, as long as we’re not doing anything silly like, oh, PASSING DATA over it. THe minute we start moving data the link gives up and goes to Palm Beach for the holiday.
I tried to explain to both EMC and the customer at the start of this engagement that replicating four Symms over even a full DS3 is very…optimistic.
So I’ve spent the last three days solid beating my head over this, more than 18 hours a day (except for yesterday which involved 7 hours + 8 hours travel time.
DWDM Limitations – how far is too far?
by Jesse on Mar.21, 2007, under DWDM, Fibrechannel, Latency, Replication
I saw this post on http://lordegg.wordpress.com and felt that the comment I posted to him there would make pretty good topic here.
Most people don’t understand that the speed of light has become a serious limitation in computing. Even the original Cray, which was installed in Los Alamos in 1976, had some million individual wires pushing data, no single one of them was more than something like a foot long, due to the time it took to push electrons across them. (I wish I could remember the exact numbers, but I’ve been up for going on 20 hours now, my brain is shutting down)
DWDM is a great technology – allowing 4-8 different signals to travel down the same link.
The down side is when you get, say 8 channels going down a 60km link, you’ve created a very wide path indeed.
But you’ve not fixed the latency problem. Under ideal circumstances latency over fibrechannel is about 2ms per kilometer.
2ms per k at 60k is 120ms. That’s each way, there is a return trip as well for each ACK transmission.
Now when you add multiple data paths, the only thing that changes is now instead of having one I/O outstanding, waiting for it’s ACK, you’ve got four or eight.
60k is more than twice what I as an engineer would recomend without some sort of repeater, especialy when you consider that optical cable is not an “ideal†transmission medium.
The speed of light has some profound implications for networking technology. Light, or electromagnetic radiation, travels at 299,792,458 meters per second in a vacuum. Within a copper conductor the propagation speed is some three quarters of this speed, and in a fibre optic cable the speed of propagation is slightly slower, at two thirds of this speed.
At 2/3 the speed of light, latency is actually closer to 3ms/km.