In a blog post yesterday, Cameron Haight writes about "The Need for IT I&O Reform". In it, he addresses a critical issue: the clash between existing manual operations processes and the need for agile, responsive, automated cloud operations processes. The money quote:
"At the end of the day, I believe that it is no longer tenable to simply layer an increasingly complex operations management tool, organization and process infrastructure on top of an already complex software and hardware foundation and to expect satisfying results."
[For timely cloud computing news and expert analysis, see CIO.com's Cloud Computing Drilldown section. ]
He particularly addresses ITIL, which is a highly structured set of processes designed to standardize IT operations, and states that it may overly focus on placing limits on flexibility, when a potentially better approach might have been to focus on the insights of those at the coal face - the sys admins, operators, console operators, and the like. Based on their insights and experience, IT I&O could be more responsive and more efficient.
Haight notes that there is a growing "movement" addressing the need to make IT I&O more efficient. This movement goes by names like devops (which I wrote about a couple of weeks ago), agile operations, agile infrastructure, etc. This movement is in contrast to a dumbed-down approach to I&O, which seeks predictability by constraining options.
I think Haight is absolutely right that the current approach to I&O is unsustainable. The highly-manual plethora of "Bs" (the Configuration Management Data Base, the Change Control Board, the Incident Tracking Board) acts as an obstacle to agility and innovation. And when you throw in scale (a hobbyhorse of mind that I ride in another blog post), what is merely inconvenient becomes untenable and unmanageable.
I'm not sure I align with a perspective that advocates letting those at the coal face make the decisions. I say this for several reasons:
• Many organizations do not hire skilled "coal miners." That is to say, there are so many smart, gifted, experienced I&O people to go around. Most organizations won't have the sharpest knives in the drawer. And the solutions the latter implement for administration are poorly designed, buggily implemented, and probably as poorly suited to scale as the manual alternatives. Standardized processes are usually implemented not to prevent brilliance, but to prevent the effects of stupidity. In effect, they replace high variability of outcomes with predictable mediocrity, which enables more sleep at night for senior management.
• One person's skilled "coal miner" is another's undisciplined hacker. The elegantly architected system administration edifice developed by one smart person becomes an unmaintainable mess when inherited by another smart person. Everyone's had the experience of a really smart person leaving an organization and no one else being able to make heads nor tails of what he leaves behind. I recently had a conversation with a highly-talented engineer at a company and discussed with him the use of one of the commercial management frameworks for Amazon Web Services. He pooh-poohed the use of a framework with the comment "I would just write one myself." Easier for him - more difficult for everyone else down the line.