In last month's Storage Magazine article I explained my theory of why we are so screwed up infrastructure-wise, or at least how we got to this point. Now I'll give you the way out. Then, I'll talk about cars.
Forget everything you know for a few minutes, or at least everything you think you know. Accept my argument that most everything we’ve done in commercial IT has been done based on transactional requirements. Open your mind. Breathe through your eyes, Danny.
There are two distinct types of data – dynamic and persistent. Dynamic is data that is in flux – this is where transactional data begins. Persistent data is just that – fixed. It doesn’t change. It is what it is, and will never be anything else.
Just because data is dynamic doesn’t mean it starts and dies within an RDBMS. Structured database data certainly starts as dynamic – but at some point it becomes a non-changing record. It’s persistent. You may have reasons to keep it inside a database forever (although I doubt they’re valid ones), but those records are still persistent – they are what they are.
Rule #1: Don’t confuse how something begins its life with how it will end. Everything begins dynamic and ends persistent. Stop delineating between structured, unstructured and semi-structured. All types live dynamically for some period, whether it’s a Word document, a movie, a credit card transaction or an email. It all ends up as fixed digital content.
Rule #2: The attributes and requirements for each type of data are vastly different – in most every sense. Read/write performance, throughput, redundancy, protection, disaster recovery, etc., count more in the dynamic phase of data life – but we’ve extended all of those philosophies to data that stopped changing, which causes 90% of our operational issues. Building data redundancies and protection schema’s to handle real money transactions is good business – backing up a non-changing data element a thousand times isn’t. Keeping your bullet proof transaction system capable of handling all the dynamic money events thrown at it is good business. But adding processing power, capacity, network infrastructure, etc., to keep it churning away rather than removing the 90% of the data that isn’t dynamic or possibly even relevant that can interfere with the real transactional stuff isn’t. Thinking you can’t make this happen is wrong.
Rule #3: The ratio of true dynamic data (and data being “treated” dynamically) to persistent data is about 1:10 – and that ratio will rapidly evolve to 1:100 and beyond. Dynamic data just doesn’t stay dynamic for very long.
Transactionally oriented systems are all about doing things fast. Perform the transaction fast, store the data fast, load the data into other systems fast. If it sits in a database, it’s easy to find – which is the point of the database. If we could, we’d have everything inside a database, but they weren’t designed for that. The persistent data world is all about finding things. That means you need to know where to look. Having stuff everywhere, inside and outside of the building, makes this task all but impossible. The whole categorizing/classifying/indexing/search thing going on today is designed to add structure so we can find things. It just seems to me that if we created two distinct “virtual” places to look for each distinct type of data, it would be a heck of a lot easier to find what we want in either. If all our dynamic data sat in one place designed to handle things like that – no matter if it’s Word or big dough – and then was moved (based on business rules) into the persistent digital content store, we’d be able to architect this store entirely differently than the dynamic store.
If the dynamic store is about speed and redundancy, then the persistent store is about infinite dynamic scale, the ability to find things easily and quickly, autonomous self-managing/self-healing infrastructure--and it should be really, really cheap to buy. If the dynamic store requires knob-turning specialists, the persistent store requires the occasional dusting. Stop trying to turn the dynamic store into the persistent one – and stop trying to make the persistent store dynamic. If you think differently, you’ll act differently. If you act differently, you’ll realize you can get back to making IT a competitive advantage.
And Now For Something Completely Different....
If I had stupid money, I'd buy a Mercedes SL65. The car wouldn't get noticed at the shopping mall, but it is a 700HP rocket ship. Silly, really. It is the very same car my girlfriend, Lindsay, just smashed while being smashed, out in L.A.
I stumbled across this thing called "Supercar Life" (www.supercarlife.com) in one of the high end rich folk magazines I read and drool over. It turned out (in a very legal, tax deductible way) that one of my biggest customers is a car freak, so as a purely business oriented gesture, I took him to this. The owner, Joel, a guy with way too much dough on his hands, figured out that there are a lot of "men" who still act like they are 12 when it comes to cars. So, for a piddly $5,000 you can fly to Pittsburgh where he rents an entire race track (Beaverun), and only lets 10 folks on it. He has (2) of each - brand spanking new - Ferrari F430, Lambo Gallardo, Porsche 911 Turbo, Astin Martin DB9, and the SL65 (Joel had his $450,000 Porsche Carrera GT sitting out front, but didn't offer to let me drive it for some reason). There are about 6 or 8 real race car driver guys - not local car club pro's - real dudes that race really expensive cars really fast that teach you how to not destroy the very nice cars that you don't own. Every few minutes, you swap cars. By the end of the day, you have driven a million bucks worth of cars really, really fast. It was awesome. If you are thinking of buying one of these rocket ships, why not spend an entire day test driving them first, and learning how not to "Lindsay" your ride? It was really first class - they put you up at the Marriott Resort and Coal Mine, feed you well, and were just terrific folks. My customer may have had to have surgery to remove the smile from his face. Now I just need to find some other car crazy customer who gives me piles of dough to justify my return trip.....


