It seems Hadoop makes for strange bedfellows. At the Microsoft PASS Summit 2011 it was announced that the upcoming versions of SQL Server (2012) and Azure, the Microsoft Cloud service will both support Hadoop. Both of these should be available in preview soon with Azure by the end of the year and the new SQL server sometime in early 2012.
Porting Hadoop to run on Windows instead of Linux which it was designed to run on will be no easy task. Part of the core functionality of Hadoop is that the OS is light and doesn't take a lot of resources up. Few people use that description for Windows. But Microsoft has signed up for the job. Also they have announced that they have engaged Hortonworks to help them with the coding. They have also said that code developed will be donated back to the community.
Having Hortonworks, the spin off consisting of many of the core Yahoo Hadoop team working on this with Microsoft is comforting on several levels. First of all it gives Microsoft some deep subject matter expertise to draw upon. But perhaps more importantly, with Hortonworks commitment to open source and the Apache Foundation it should help allay any fears of the usual suspects who look warily at anything Microsoft does regarding open source.
What many expect is what Microsoft will offer is a set of connectors between MS SQL and Hadoop that will allow you to move data back and forth between the two. But running Hadoop on Windows may be the most difficult task on this menu.
Part of the plan is also to have other Microsoft tools access data in Hadoop. Can you imagine importing Hadoop data into Excel for instance? You have to give Microsoft credit here for the vision and the apparent good intentions in being a good open source player here.
Microsoft supporting open source projects, donating code back and promising compatibility with the Apache version of Hadoop? What will be next, yellow elephants flying?
As co-founder and Managing Partner at The CISO Group, Alan Shimel is responsible for driving the vision and mission of the company. The CISO Group offers security consulting and PCI compliance management for the payment card industry. Prior to The CISO Group, Alan was the Chief Strategy Officer at StillSecure. Shimel was the public persona of StillSecure as it grew from start up to helping defend some of the largest and most sensitive networks in the world.
Shimel is an often-cited personality in the technology community and is a sought-after speaker at industry and government conferences and events. His commentary about the state of security, open source and life is followed closely by many industry insiders via his blog and podcast, "Ashimmy, After All These Years" (www.ashimmy.com). Alan is now also a regular contributor to The CISO Group’s security.exe blog and podcast.
Alan has helped build several successful technology companies by combining a strong business background with a deep knowledge of technology. His legal background, long experience in the field, and New York street smarts combine to form a unique personality.
Disclosure: The CISO Group sells a software-as-a-service PCI compliance application called SAQPro. The company is independent and does not represent any other vendor's products as a reseller.
Policy on comments: Respectful discussion is welcomed! However comments that use inappropriate language, consist of name calling or personal attacks, or include accusations of wrongdoing are not appropriate. Those comments will be deleted or edited.