Troubleshooting Azure Stream Analytics jobs with SELECT INTO

Azure Stream Analytics is a fully managed service to do real time processing of data with a flexible SQL-like language. You can easily construct queries to complete complex analysis. However, it also means sometimes the system can be hard to troubleshoot when it does not run as expected. Here is one trick that can help…


How to deal with missing events in streaming data?

Streaming data is often not perfect – some of the events can be missing and some can be generated or received with delay. At the same time downstream applications may require input data within regular intervals (e.g. every 5 seconds) Some customers asked us – how can Azure Stream Analytics be used to convert a…


Handling Json array in Stream Analytics Query

This week, I am sharing a query question asked in stackoverflow to illustrate how to handle json array in Stream Analytics Query:   Problem   I retrieve some weatherdata from an external API. This is returned as JSON and send to an Azure IoT hub. Stream analytics processes the json into a proper format, but I…


Querying JSON array with Azure Stream Analytics

Kent Weare has written a nice post on querying Json array with Azure Stream Analytics. He is getting device reads off of an Azure Event Hub. These reads are being aggregated on the publisher side and placed into a single message/event. Since the publisher is creating a message structure that contains many device reads for that specific interval Kent…


Query Pattern of the Week: Use expressions inside a TIMESTAMP BY clause

Azure Stream Analytics allows expressing complex event processing rules using a simple SQL-like query language. Given the temporal nature of Stream Analytics queries, it is important to specify a timestamp for every input event.  By default, Stream Analytics will use arrival time of the input event – e.g. if Event Hub is used as an…

0

Query Pattern of the Week: Send data to multiple outputs

Have you checked out our team’s collection of Common Stream Analytics Query Patterns? This location acts as a repository for query patterns commonly used by our customers. One pattern that frequently comes up in real-world applications is directing job data to multiple outputs to enable both a hot path and a cold path for data….

0

Common Stream Analytics Query Patterns

We have received many questions and requests for help from customers who aren’t sure how to write their stream processing logic in the Stream Analytics Query Language.  We are happy to announce that we have released a guide that captures common query patterns and describes them fully with sample data, code snippets, and explanations: https://azure.microsoft.com/en-us/documentation/articles/stream-analytics-stream-analytics-query-patterns/…

0

How To: Query for ‘All’ events and ‘No’ event scenarios

All and Nothing Azure Stream Analytics aspires to make low-latency, near-real-time stream computations as easy to use as typing a SQL query.  But while SQL (and its Stream Analytics dialect) is a powerful language, there are some “tricks of the trade” to quickly and easily expressing common stream-analytic concepts. Today, we look at two common…

0