HDInsight tools for IntelliJ & Eclipse April Updates

  We are pleased to announce the April updates of HDInsight Tools for IntelliJ & Eclipse. This is a quality milestone and we focus primarily on refactoring the components and fixing bugs. We also added Azure Data Lake Store support and Eclipse local emulator support in this release. The HDInsight Tools for IntelliJ & Eclipse…

0

Azure Data Lake U-SQL April 25 2017 Updates: Introducing Packages, UNPIVOT INCLUDE NULLS, fast file set preview flag, R extension returns dataframes, exporting your cluster database with sample data to your local run and more!

We have concluded the rollout of our April 2017 refresh to all the regions today. Here are the April 2017 Updates for Azure Data Lake U-SQL and Developer Tooling! The main items are the release of the package feature that allows you to bundle assembly reference statements, variable declarations into a shareable package and reduce…

0

Cloudera clusters now run with Azure Data Lake Store

We are excited to announce that with today’s release of Cloudera Enterprise 5.11 you can now run Spark, Hive, and MapReduce workloads in a Cloudera cluster on Azure Data Lake Store (ADLS). Cloudera customers can now take advantage of the many benefits of running clusters on ADLS. And ADLS brings to its customers another valuable…

0

Azure Data Lake U-SQL March 9 2017 Updates: Deprecations turn into errors, PIVOT/UNPIVOT, cross ADLS account U-SQL catalog sharing, nuget packages and more!

After mainly internal service updates after our general availability, we released several new U-SQL features in our release last week. Note that these updates are now available in all regions, including the new Europe North region. Here are the March 9 2017 Updates for Azure Data Lake U-SQL and Developer Tooling! The main take away…

2

Ingest data into Azure Data Lake Store with StreamSets Data Collector

Today, I want to give a shout out to one of our partners who has a great offering for Azure Data Lake Store customers.  When ingesting large scale data into a data lake, data often requires data transformations such as cleaning and filtering.  StreamSets Data CollectorTM offers an open source software for building and deploying…

0

Enabling U-SQL Advanced Analytics for Local Execution

After we announced the ability for U-SQL to massively distributed Python code in the Azure Data Lake Analytics service, a lot of developers have been asking us when the the Python support will work using U-SQL Local Execution. In this post, we’ll describe how to make that happen. To set expectations, what we will describe below is not officially supported – we do…

0

HDInsight tools for IntelliJ & Eclipse December Updates

  We are pleased to announce the December updates of HDInsight Tools for IntelliJ & Eclipse. The HDInsight Tools for IntelliJ & Eclipse serve the open source community and will be of interest to HDInsight Spark developers. The tools run smoothly in Linux, Mac and Windows. The recent release focuses on users’ feedback to ensure…

0

Azure Data Lake Store is now generally available

Today we announced general availability of Azure Data Lake services including Azure Data Lake Store – the first cloud Data Lake built to the open Hadoop File System (HDFS) standard with enterprise grade security and massive scale. You can now unlock value from all your unstructured, semi-structured and structured data by running massively parallel analytics…