Enabling U-SQL Advanced Analytics for Local Execution

After we announced the ability for U-SQL to massively distributed Python code in the Azure Data Lake Analytics service, a lot of developers have been asking us when the the Python support will work using U-SQL Local Execution. In this post, we’ll describe how to make that happen. To set expectations, what we will describe below is not officially supported – we do…

1

U-SQL Deprecation Update: Migration of Data Source Credentials and Removal of CREATE CREDENTIAL, ALTER CREDENTIAL and DROP CREDENTIAL

Back in October, we announced that we simplified the U-SQL Credentials by merging the password secrets that are being created in Powershell and the other parts of the credential object into credentials that are being completely created with a Powershell command. This reduces one statement from the creation process. During the initial phase, we did…


U-SQL Deprecation notice: PARTITION BY BUCKET will be removed

Hi all In the upcoming refresh, we are removing the deprecated syntax PARTITION BY BUCKET and will raise an error. Thus, if you have not yet updated your table definitions with the previously announced new syntax, please do so now or your scripts will fail starting some day in February! For more information, please see:…


Introducing: Microsoft Azure Data Lake Tools for Visual Studio Code

Welcome to the Microsoft Azure Data Lake Tools preview for Visual Studio Code, an extension for developing U-SQL projects against Microsoft Azure Data Lake! This extension provides you a cross-platform, light-weight, keyboard-focused authoring experience for U-SQL while maintaining a full set of development functions. Want to make this extension even more awesome? Share your feedback….


Microsoft Azure Data Lake Tools for Visual Studio Code

Welcome to the Microsoft Azure Data Lake Tools preview for Visual Studio Code, an extension for developing U-SQL projects against Microsoft Azure Data Lake! This extension provides you a cross-platform, light-weight, keyboard-focused authoring experience for U-SQL while maintaining a full set of development functions. Want to make this extension even more awesome? Share your feedback….


Problems with new File Set (update 2016-12-14 – 16:30 PST)

In the latest push we enabled the new faster file set feature per default. Unfortunately that caused a regression that can manifest itself in one of the following ways: Your EXTRACT statement extracts 0 rows, even though there should be more data. You run into the following error message: E_RUNTIME_SYSTEM_CODEGENFAILURE — Internal error! The SV_Extract_Combine…


Azure Data Lake U-SQL October 2016 Updates: Deprecations turn into errors, sampling is live, sharing catalog objects across ADLA accounts, outputting headers and more!

We seem to be just cranking out new stuff :). Here are the October 2016 Updates for Azure Data Lake U-SQL! The main take away is that the October refresh has now removed the old deprecated syntax of the items we have announced over the last couple of release notes! Thanks for those who volunteered…

1

How to register U-SQL Assemblies in your U-SQL Catalog

U-SQL’s extensibility model heavily depends on your ability to add your own custom code. Currently, U-SQL provides you with easy ways to add your own .Net-based code, in particular C#, but you can also add custom code written in other .Net languages, such as VB.Net or F#. You can even deploy your own runtime for…

3

Introducing Image Processing in U-SQL

Rukmani Gopalan – Senior Program Manager Apostolos “Toli” Lerios – Entrepreneur in Residence and Principal Software Engineer Introduction It is my great pleasure to coauthor this blog with Apostolos “Toli” Lerios, an expert at image processing and a serial entrepreneur, he has founded multiple startups and also worked as an image architect at Facebook. If…

4