Understanding HDInsight Custom Node VM Sizes

With the 02/18/2015 update to HDInsight and Azure Powershell 0.8.14 we introduced a lot more options for configuring custom Head Node VM size as well as Data Node VM size and Zookeper VM size.  Some workloads can benefit from increased CPU performance, increased local storage throughput, or larger memory configurations.  You can only select custom…

0

Azure PowerShell 0.8.14 Released, fixes problems with pipelining HDInsight configuration cmdlets

We recently pushed out the 0.8.14 release of Azure PowerShell. This release includes some updates to the following cmdlets to ensure that values passed in via the PowerShell pipeline, or via the -Config parameter, are maintained: Set-AzureHDInsightDefaultStorage Add-AzureHDInsightStorage Add-AzureHDInsightMetastore Previously if you had done something like: $myconfig = New-AzureHDInsightClusterConfig -ClusterSizeInNodes 2 -ClusterType HBase $myconfig =…

0

How to pass Hadoop configuration values for a job on HDInsight

I came across the question a few times recently from several customers– “how do we pass hadoop configurations at runtime for a mapreduce job or Hive Query via HDInsight PowerShell or .Net SDK?” I thought of sharing the answer here with others who may run into the same question. It is pretty common in Hadoop…

0