This week, at DataWorks Summit, Microsoft announced the general availability of Azure HDInsight 3.6. The company says that the platform is backed by its enterprise grade SLA.
Windows Azure HDInsight is a service that deploys and provisions Apache Hadoop clusters in the Azure cloud, providing a software framework designed to manage, analyze and report on big data.
Microsoft explains that HDInsight 3.6 brings updates to various open source components in Apache Hadoop & Spark eco-system to the cloud, which allows customers to deploy them easily and run them reliably on an enterprise-grade platform.
The new Azure HDInsight 3.6 is claimed as a major update to the core Apache Hadoop & Spark platform as well as with various open source components. HDInsight 3.6 has the latest Hortonworks Data Platform (HDP) 2.6 platform, a collaborative effort between Microsoft and Hortonworks to bring HDP to market cloud-first.
Microsoft says:
We are introducing capabilities to support real-time streaming solutions with Spark integration to Azure Event Hubs and leveraging the structured streaming connector in Kafka for HDInsight.
This will allow customers to use Spark to analyze millions of real-time events ingested into these Azure services, thus enabling IoT and other real-time scenarios.