Processing compressed event streams with Azure Stream Analytics

Did you know that Azure Stream Analytics now supports input data with compression data formats such as GZIP and Deflate streams? This is especially critical in scenarios where either bandwidth is limited, and/or message size is high. This blog shows you how to squeeze the most value out of your data with compression input formats….


8 reasons to choose Azure Stream Analytics for real-time data processing

Processing big data in real-time is now an operational necessity for many businesses. Azure Stream Analytics is Microsoft’s serverless real-time analytics offering for complex event processing. It enables customers to unlock valuable insights and gain competitive advantage by harnessing the power of big data. Here are eight reasons why you should choose ASA for real-time…


Now in Public Preview: Visual Studio tools for Azure Stream Analytics on IoT Edge

Azure Stream Analytics (ASA) on IoT Edge empowers developers to deploy real-time analytical intelligence closer to IoT devices so that they can unlock the full value of device-generated data. Today we are happy to announce that Visual Studio tools for ASA now supports development of ASA on IoT Edge, in addition to development of cloud…

0

Improved Stream Analytics output support in Visual Studio

Power BI and Azure Data Lake Store outputs are now supported in Visual Studio tools. Previously users can only create or view jobs with these types of outputs in the Azure portal. Now all these actions can also be performed in Visual Studio tools. With this capability, developers can enjoy the same powerful developer experience…

0

Event Processing Ordering Design Choices for Azure Stream Analytics

In this blog, I would like to explain the design choices we made with Azure Stream Analytics for: ‘When’ in processing-time results are materialized, and ‘How’ the results are materialized. These design choices reduce implementation complexities and run time resource usage while meeting customers’ requirements for their scenarios. Firstly, I would like to point out…


SU Utilization Metric

In order to achieve low latency streaming processing, Azure Stream Analytics jobs perform all processing in memory. When running out of memory, the streaming job fails. As a result, for a production job, it’s important to monitor a streaming job’s resource usage, and make sure there is enough resource allocated, in order to keep the…


Using Azure Stream Analytics JavaScript UDF to lookup values in JSON array

JavaScript UDF (User-Defined Function) allows you to handle complex JSON schema and keep your query clean. In this blog you will learn how to handle nested JSON arrays with a JavaScript UDF. Below is an example event generated by an IoT gateway. There is an array of two devices – device01 and device02; each device…

0

Processing Configurable Threshold Based Rules in Azure Stream Analytics

This post covers the usage of Azure Stream Analytics to process configurable threshold based rules. Canonical scenarios where an alert is to be generated when an event with a certain value occurs or when an aggregated value exceeds a certain threshold can be articulated as threshold based rules in Azure Stream Analytics. These queries are…


How to achieve exactly-once delivery for SQL output

Azure Stream Analytics guarantees exactly-once processing within the processing pipeline. However, it currently doesn’t ensure end to end exactly-once delivery to output sink. Instead, it guarantees at-least-once delivery to output sink. When using SQL output, we can achieve exactly-once semantics if the following requirements are met: all output streaming events have a natural key, i.e….


Output to Azure Data Lake Store is Generally Available

We are excited to announce that the capability to output to Azure Data Lake Store, a hyper-scale repository for big data analytics workloads from Azure Stream Analytics is now Generally Available. This integration further advances the ease of enablement of a Lambda architecture where the data that is subjected to real time stream analytics is…

0