Azure Data Lake Command-line Quickstart using Azure Cloud Shell

Have you been using Azure Data Lake Analytics mainly from the Azure Portal or Visual Studio interfaces? Do you want to use Data Lake Analytics programmatically without installing anything? Do you want to get started with Azure PowerShell, but you’re on a Mac or Linux machine? Here’s how to get started with Azure PowerShell or…

0

Struggling to get insights for your Azure Data Lake Store? Azure Log Analytics can help!

Customers love to use Azure Data Lake across their organizations by enabling their Data Lake Analytics accounts to use multiple Data Lake Store accounts as data sources.  Business can have flexibility  with resource usage and allocation, but this creates challenges for the Data Lake account administrators who struggle with understanding what is being used, how…


Debugging Azure Data Lake Job Failures Made Easy (part 2) – Efficiently troubleshoot anomalies in recurring jobs

Azure Data Lake Analytics recently announced advanced job tracking and management features that make it easy to work with pipelines and recurring jobs. Releases after version 2.3.0000.1 of Azure Data Lake Tools for Visual Studio, introduce new features that simplify analyzing and troubleshooting such jobs. Troubleshooting issues in recurring job is a time-consuming task. It…


How to Save Money and Control Costs with Azure Data Lake Analytics

Where there is great power there is great responsibility -Winston Churchill Azure Data Lake Analytics with its serverless approach and scale-up U-SQL query execution puts a lot of power in developers hands. As you start exploring what is possible with Azure Data Lake and your datasets start growing, it becomes ever more important for developers…

0

Get more out of your U-SQL scripts — Reuse them by adding script parameters with Azure PowerShell

Do you submit U-SQL jobs to Data Lake Analytics using Azure PowerShell? Do you find yourself making lots of minor changes to your U-SQL script between job submissions? Make life easier by parameterizing your U-SQL script and passing in parameter values when submitting the job through Azure PowerShell. You need two things to make this…

5

Discover input/output paths of U-SQL jobs using Azure PowerShell

Do you use Azure Data Lake Analytics? Have you ever wanted to programmatically fetch the input and output paths of one of your U-SQL jobs? Now you can! This is especially useful for developers who want to quickly debug an input file, fetch the results of an analysis, or check which files a particular job…

0

Ad-hoc query support in Azure Data Lake Tools for Visual Studio

Developers using Azure Data Lake Tools for Visual Studio can now create single U-SQL scripts without first creating a solution or project. When working with a data lake it is often necessary to run ad-hoc queries. Developers need to verify a part of code logic or run quick experiments, admins may view database catalogs or…


Run your PySpark Interactive Query and batch Job in Visual Studio Code

We are excited to introduce the integration of HDInsight PySpark into Visual Studio Code (VSCode), which allows developers to easily edit Python scripts and submit PySpark statements to HDInsight clusters. This interactivity brings the best properties of Python and Spark to developers and empowers you to gain faster insights.

0