In an organizational setting, it's often referred to "analysis paralysis".
Last week we had a database server crash twice. This server provides the company's most critical information system. Two-thirds of the company relies on this server to do its daily tasks. Because it was so critical to the daily grind of the company, the previous caretakers decided that a "hands off" approach was most appropriate for this system.
It crashed Monday evening of last week. We spent Tuesday doing a postmortem and identified the likely culprit of the crash. We spent the rest of the week "discussing" what to do about the problem. It crashed again on Friday evening. Both crashes seemed to have been caused by the same problem. So, while we were arguing about how to solve the problem, the problem reached up and bit us again.
The major complicating factor is that this machine is woefully behind on patches. The OS is 5 years old with very few patches installed (and no "service packs"). The database is at least 8 revs behind current and the application framework was old when it was installed 4 years ago.
Trying to bring all of this up to date will most likely break the application that the server runs.
We now have telemetry coming from the server that we think will tell us when the error condition is getting close. This will help us limp along on this machine until we can get a replacement up and running.
But this brings up some good questions:
1. Why isn't this business-critical system running in a more robust architecture?
2. Why was this system neglected for so long?
3. Why hasn't there been a major effort to stabilize this system?
4. Why doesn't the company have dedicated team of DBAs, developers, and sys-admins to keep this system running smooth?
Yeah, the company can come up with reasonable sounding answers to rationalize away these questions, but it still leaves us with a fragile mission critical info system.
Frustrating.
Monday, January 28, 2008
Pride in work
I've been at the new job now for around half a year. I'm still having trouble finding some way of expressing some level of personal pride and personal accomplishment in what I'm doing there.
I want things to be done well. I want things to be done right. Why is that so hard for people to embrace? I seem to get shot down every time I want to take extra time to get something done correctly. This problem is especially bad if doing things right means spending extra money, even if it's not all that much extra.
The quality of the IT systems that professional Systems Administrators create and or enable for our companies reflect on our professional skills and abilities. Why don't more people understand that and act accordingly?
I want things to be done well. I want things to be done right. Why is that so hard for people to embrace? I seem to get shot down every time I want to take extra time to get something done correctly. This problem is especially bad if doing things right means spending extra money, even if it's not all that much extra.
The quality of the IT systems that professional Systems Administrators create and or enable for our companies reflect on our professional skills and abilities. Why don't more people understand that and act accordingly?
Monday, January 7, 2008
What do I have to complain about?
I mean really?
I'm successful by most measures. I have a lovely wife and loving son. I make good money (in the grand scale of things). I'm well fed, well clothed and I have a warm bed to sleep in at night.
I just feel... like my effort in life isn't adding up to anything.
Work takes me away from my family more than I would like. I can't be everything I want to be for my family.
I can't get enough done at work to satisfy my inner geek. And working my butt off to make someone else rich (while not getting rich myself) is really starting to rub me the wrong way.
Anyway, that's my opening rant. I'm sure I'll complain more about a lot more stuff as time goes on.
I'm successful by most measures. I have a lovely wife and loving son. I make good money (in the grand scale of things). I'm well fed, well clothed and I have a warm bed to sleep in at night.
I just feel... like my effort in life isn't adding up to anything.
Work takes me away from my family more than I would like. I can't be everything I want to be for my family.
I can't get enough done at work to satisfy my inner geek. And working my butt off to make someone else rich (while not getting rich myself) is really starting to rub me the wrong way.
Anyway, that's my opening rant. I'm sure I'll complain more about a lot more stuff as time goes on.
Subscribe to:
Posts (Atom)
