How to Lock a Resource Group to prevent accidental deletion of resources like HDInsight

Did you know it is possible to prevent accidental deletion of resources in Azure? This could apply to any number of resource, HDInsight, Stream Analytics jobs, Data Factories, DocumentDB accounts, etc. We can add a lock to the resource group to prevent resources from being removed inadvertantly. I found out the hard way when someone…


Azure Data Factory JSON Changes in July 2015

Azure Data Factory factories are designed with a series of fairly simple JSON documents and uploaded to Azure using either the web interface, PowerShell, .Net, or Visual Studio. If you were using the pre-release public preview of Azure Data Factory, you should be aware of a recent change in the SDK,  in order to make…


Spark on Azure HDInsight is available

  Spark on Azure HDInsight (public preview) is now available! The following components are included as part of a Spark cluster on Azure HDInsight. Spark 1.3.1 Comes with Spark Core, Spark SQL, Spark streaming APIs, GraphX, and MLlib. Anaconda. A collection of powerful packages for python. Spark Job Server, which allows your to submit jars…


Problems When Using a Shared Default Storage Container with Multiple HDInsight Clusters

We have seen several cases come in to Microsoft Support that ended up being caused by having multiple HDInsight clusters using the same Azure Blob Storage container for default storage. While we don’t currently block you from creating clusters using the same default storage container, we do know that this can cause some specific problems….


Using Apache Flume with HDInsight

Gregory Suarez – 03/18/2014   (This blog posting assumes some basic knowledge of Apache Flume)   Overview When asked if Apache Flume can be used with HDInsight, the response is typically no. We do not currently include Flume in our HDInsight service offering or in the HDInsight Server platform ( which is a single node…

Getting started with Sqoop in HDInsight

My name is Farooq and I am with HDinsight support team here at Microsoft. In this blog I will try to give some brief overview of Sqoop in HDinsight and then use an example of importing data from a Windows Azure SQL Database table to HDInsight cluster to demonstrate how you can get stated with…