Azure Data Lake Command-line Quickstart using Azure Cloud Shell

Have you been using Azure Data Lake Analytics mainly from the Azure Portal or Visual Studio interfaces? Do you want to use Data Lake Analytics programmatically without installing anything? Do you want to get started with Azure PowerShell, but you’re on a Mac or Linux machine? Here’s how to get started with Azure PowerShell or…


Struggling to get insights for your Azure Data Lake Store? Azure Log Analytics can help!

Customers love to use Azure Data Lake across their organizations by enabling their Data Lake Analytics accounts to use multiple Data Lake Store accounts as data sources.  Business can have flexibility  with resource usage and allocation, but this creates challenges for the Data Lake account administrators who struggle with understanding what is being used, how…


Cloudera clusters now run with Azure Data Lake Store

We are excited to announce that with today’s release of Cloudera Enterprise 5.11 you can now run Spark, Hive, and MapReduce workloads in a Cloudera cluster on Azure Data Lake Store (ADLS). Cloudera customers can now take advantage of the many benefits of running clusters on ADLS. And ADLS brings to its customers another valuable…


Ingest data into Azure Data Lake Store with StreamSets Data Collector

Today, I want to give a shout out to one of our partners who has a great offering for Azure Data Lake Store customers.  When ingesting large scale data into a data lake, data often requires data transformations such as cleaning and filtering.  StreamSets Data CollectorTM offers an open source software for building and deploying…


Azure Data Lake Store is now generally available

Today we announced general availability of Azure Data Lake services including Azure Data Lake Store – the first cloud Data Lake built to the open Hadoop File System (HDFS) standard with enterprise grade security and massive scale. You can now unlock value from all your unstructured, semi-structured and structured data by running massively parallel analytics…


Introducing File and Folder ACLs for Azure Data Lake Store

Overview We’re excited today to announce the availability of File and Folder ACLs for the Azure Data Lake Store. Many of you have been eagerly awaiting this feature because it is critical in securing their big data. When we launched the preview of Data Lake Store in October 2015, filesystem security was controlled by a…


April Updates to Azure Data Lake Analytics and Azure Data Lake Store

Hello everyone, the Azure Data Lake engineering team has been working hard on refining the services and we’ve made a few updates for April that provide basic improvements across the board. You can find detailed descriptions of all the updates in the following release notes: U-SQL – April 2016 Release Notes Azure Data Lake Tools for Visual Studio -…


Organize and discover your big data in the Azure Data Lake with Azure Data Catalog

Enterprise data is growing at a remarkable pace today. A large portion of the growth in data is coming from a wide variety of unstructured and semi structured sources such as sensors, social, click streams and machine generated logs. Businesses of all sizes face the challenge of storing, organizing and utilizing their data in an…


Hello world!

Welcome to the official blog of the Azure Data Lake Engineering team. On this blog we will cover the different products part of Azure Data Lake including Azure Data Lake Analytics, Azure Data Lake Store and HDInsight.

1