Introducing HDInsight integration with Azure Log Analytics Preview

Cross Post from https://azure.microsoft.com/en-us/blog/introducing-hdinsight-integration-with-azure-log-analytics/   Operating Big Data applications successfully at scale is key consideration for our enterprise customers. Typical Big Data applications span across multiple different technologies, as well as operating environments. Monitoring this complex infrastructure in an efficient way is the key challenge for our customers. Today, we announce the preview of HDInsight cluster…


General availability of HDInsight Interactive Query – blazing fast queries on hyper-scale data

Cross post from https://azure.microsoft.com/en-gb/blog/general-availability-of-hdinsight-interactive-query-blazing-fast-data-warehouse-style-queries-on-hyper-scale-data-2/ It’s 2017, and big data challenges are as real as they get. Our customers have petabytes of data living in elastic and scalable commodity storage systems such as Azure Data Lake Store and Azure Blob storage. One of the central questions today is finding insights from data in these storage systems…


HDInsight : BUILD Hive Labs are Available Now

Got some time to learn Big Data Technologies? How about starting with Hive which is considered the de facto standard for SQL queries in Hadoop We just released  HDInsight labs used during the BUILD conference code challenge. You will need 2 things to run these labs 1- HDInsight Cluster – How to create? 2- Step by Step Instructions…


Provision HBase cluster with Azure Data Lake Store in a few easy steps

Last week, we announced public preview of HDInsight HBase with Azure Data Lake Store. You can read the announcement here With this release there is virtually no limit on amount of data you can store in your HBase cluster. I created a GIF that will guide you on how to create HBase Cluster with Azure Data…


Azure HDInsight: How to run Presto in one simple step and query across data sources such as Cosmos DB, SQL DB & Hive

I have seen in past few months many inquiries on how to run Presto in HDInsight In this post we have provided an easy way for you to install Presto in HDInsight as well as configure various data sources which Presto can query. One of the unique advantages of HDInsight is decoupling between storage and…


Exposing Hive!

I sat down with Justin Scott (Application Development Manager at Microsoft working with our top customers) to talk about Apache Hive and where it’s heading. You can listen to channel 9 podcast now


Azure HDInsight 3.6 – Five things that will make a data developer happy

Working with Hive, I regularly find myself staring at a csv/tsv/json files wondering where to start…. Hive View 2.0 is a new Web Experience in HDInsight 3.6 that greatly simplifies many common Hive Tasks and makes it easy to author and debug hive queries. In this post, we will look into 5 key feature that…


Hive Metastore in HDInsight –Tips, Tricks & Best Practices

When you create a Hive table, the table definition (column names, data types, comments, etc.) are stored in the Hive Metastore. Hive Metastore is critical part of Hadoop architecture as it acts as a central schema repository which can be used by other access tools like Spark, Interactive Hive (LLAP), Presto, Pig and many other…