Discover input/output paths of U-SQL jobs using Azure PowerShell

Do you use Azure Data Lake Analytics? Have you ever wanted to programmatically fetch the input and output paths of one of your U-SQL jobs? Now you can! This is especially useful for developers who want to quickly debug an input file, fetch the results of an analysis, or check which files a particular job…

0

Ad-hoc query support in Azure Data Lake Tools for Visual Studio

Developers using Azure Data Lake Tools for Visual Studio can now create single U-SQL scripts without first creating a solution or project. When working with a data lake it is often necessary to run ad-hoc queries. Developers need to verify a part of code logic or run quick experiments, admins may view database catalogs or…


Run your PySpark Interactive Query and batch Job in Visual Studio Code

We are excited to introduce the integration of HDInsight PySpark into Visual Studio Code (VSCode), which allows developers to easily edit Python scripts and submit PySpark statements to HDInsight clusters. This interactivity brings the best properties of Python and Spark to developers and empowers you to gain faster insights.

0

Getting new insights into your usage of Data Lake Analytics

Users of Azure Data Lake Analytics consistently ask for more insights about their usage for both monitoring jobs and also to understand how much they are spending on big data. Today, we are announcing some key updates to the ADLA account overview that addresses some of the most common requests.  Life after the new overview …

0

Find your U-SQL jobs in Azure Data Lake Analytics with one click.

If your Data Lake Analytics account is heavily used, you might have to scroll through a long list of jobs to find just the ones you submitted. Relief is here. The new My Jobs quick filter in the portal makes it easy for developers to focus on just their jobs. To see it in action, watch this…

0

Organize your pipeline and recurring jobs easily with Data Lake Analytics (part 2)

Identify performance problems and reduce failed jobs with pipeline and recurring job information In part 1, we showed you how to tag and explore your pipeline and recurring jobs: Tag jobs with the new pipeline and recurring job metadata using Azure PowerShell Explore pipeline and recurring jobs using Azure Portal and Azure PowerShell In this…


Continuous integration made easy with MSBuild support for U-SQL (preview)

Azure Data Lake provides enterprise ready big data as a service on Azure. A key requirement of enterprises is the ability to automate code integration processes to ensure fast, consistent and promotion of tested code. Today, we are pleased to announce a highly requested feature from the Azure Data Lake customers: The ability to use…


Simple database copies with the Azure Data Lake Database Export Wizard

Azure Data Lake Tools for Visual Studio now provides the ability to export all or part of a database associated with an ADL Analytics (ADLA) account into a database on a local machine. This capability is very useful when creating local environment for development or debugging. The concept of a database is used to group…


Organize your pipeline and recurring jobs easily with Data Lake Analytics (part 1)

 Tagging and exploring pipeline and recurring jobs with metadata In a previous blog post, we introduced how managing/monitoring pipeline and recurring jobs is made easier with new concepts we added to Data Lake Analytics. Let’s take a deeper look at how to leverage this new capability. This is part 1 of a 2-part series. In…