Microsoft and Hortonworks, the spinoff company of ex-Yahoo employees who developed the Hortonworks Data Platform (HDP) used in Big Data deployments, announced today the availability of a beta version of HDP for Windows Server.
HDP is available for download from the Hortonworks site. Data is stored in the HDFS file system, so HDP can coexist with your current server installations and there is no conflict between the two. Microsoft plans for integration between its own products and services and HDP in a future release.
General availability of HDP for Windows Server is slated for the second calendar quarter of 2013.
HDP started as a project inside Yahoo back around 2005. Once the project was completed, Yahoo turned over its secret sauce to the Apache Group as a fully open source project, since Hadoop itself was built on another open source project, Google's MapReduce.
Very quickly it was adopted by Google, Twitter and Facebook and is now expanding into business use for running analytics on vast amounts of data in parallel. But up to now, the HDP platform has only been available on Linux. While Linux has grown into a formidable server platform, it accounts for 21% of the market, according to IDC.
Windows Server accounts for 51% of the market and was a logical choice to expand the platform. HDP for Windows Server is 100% open source and is the result of 18 months of work between Hortonworks and Microsoft. All of Microsoft's work to improve HDP has been contributed back to the open source community, according to Dave McJannet, vice president of marketing at Hortonworks.
Because the Windows and Linux distributions are identical and run where the data resides, apps written in Visual Studio can access a Big Data service on either platform. HDP includes high availability, security, data services and management tools and interfaces.