XBox: Analytics on petabytes of gaming data with Azure HDInsight

Cross post from https://azure.microsoft.com/en-us/blog/how-xbox-uses-hdinsight-to-drive-analytics-on-petabytes-of-telemetry-data/ Microsoft Studios produces some of the world’s most popular game titles including the Halo, Minecraft, and Forza Motorsport series. The Xbox product services team manage thousands of datasets and hundreds of active pipelines consuming hundreds of gigabytes of data each hour for first party studios. Game developers need to know the health…


Azure HDInsight Performance Insights: Interactive Query, Spark and Presto

Cross post from https://azure.microsoft.com/en-us/blog/hdinsight-interactive-query-performance-benchmarks-and-integration-with-power-bi-direct-query/ Fast SQL query processing at scale is often a key consideration for our customers. In this blog post, we compare HDInsight Interactive Query, Spark and Presto using an industry standard benchmark derived from the TPC-DS Benchmark. These benchmarks are run using out of the box default HDInsight configurations, with no special optimizations….


Azure HDInsight Integration with Azure Log Analytics is now generally available

Cross post from https://azure.microsoft.com/en-us/blog/azure-hdinsight-integration-with-azure-log-analytics-is-now-generally-available/   I am excited to announce the general availability of HDInsight Integration with Azure Log Analytics. Azure HDInsight is a fully managed cloud service for customers to do analytics at scale using the most popular open-source engines such as Hadoop, Hive/LLAP, Presto, Spark, Kafka, Storm, HBase etc. ​ Thousands of our customers…


Azure #HDInsight @Microsoft Openness Day

I will be speaking at Microsoft Openness day on December 5th. Register here Session Abstract: Hadoop, Kafka, Spark and NoSQL solutions have emerged as the most appropriate open source technologies for data processing at massive scale and cost effectively. Azure HDInsight is Microsoft’s OSS analytics offering available to Azure customers since 2013. It is a…