Troubleshooting Azure Stream Analytics jobs with SELECT INTO

Azure Stream Analytics is a fully managed service to do real time processing of data with a flexible SQL-like language. You can easily construct queries to complete complex analysis. However, it also means sometimes the system can be hard to troubleshoot when it does not run as expected. Here is one trick that can help…


How to configure Azure Stream Analytics outputs to skip events that cannot be written due to conversion errors or schema mismatch

By default, when output events cannot be written to the external storage due to being non-conforming data (null columns when destination column is non-nullable, longer strings than the destination column support, values with types that cannot be written in the output etc.) they cause the job to stop processing new events and continuously retry the…


Why aren’t my ASA job results showing up in Azure SQL Server table? How do I debug?

Often we receive questions from users of Azure Stream Analytics which help us improve our documentation or error handling. These Q&A’s also help other users. Here is one such case of figuring out why ASA results may not be appearing in Azure SQL server table. Question: I’m having trouble outputting my ASA job results into…


Learn more about Azure Stream Analytics Time Skew Policies

In Stream Analytics, all data stream events have a timestamp associated with them. As all events are temporal in nature and timing of arrival of the event is how the timestamp is assigned, considerations exists for both the tolerance of out of order events and the late arrival of events to the Stream Analytics job….


Tips for Troubleshooting Stream Analytics jobs with PowerBI Output

In this blog post, we cover basic troubleshooting guidance for Azure Stream Analytics jobs with real-time Power BI dashboards. For an introduction to ASA and PowerBI integration, check out Azure Stream Analytics & Power BI: Live dashboard for analytics in real-time on streaming data. 1. Check for output events   As a first step for debugging your…

0

How to debug your ASA job, step by step

In a recent series of blog posts, we have gone over how diagnostic information is surfaced in Azure Stream Analytics, as well as the potential types of issues a job could encounter.  This posts brings it all together with a step by step flow for debugging issues with ASA jobs. First when I create and define the…


Debugging each stage of your ASA job

This blog post will explain how Stream Analytics jobs work at a high level and where to look for information for debugging your ASA job’s inputs, query and output. There are multiple areas where you may potentially see issues with ASA Jobs: Connecting to data sources (inputs and outputs) Consuming/reading and de-serializing data Query execution…


Intro to Diagnostics for Azure Stream Analytics

Azure Stream Analytics offers a number of diagnostics tools to help investigate problems with streaming jobs: 1.       Management Services (Also known as : Operations Logging) 2.       Monitoring metrics 3.       No-Output Diagnostics 4.       Alerts On Metrics 5.       Alerts On Operations Logs   1.       Management Services: This is a standard way in Azure services to supply operational…


Improved Stream Analytics Monitoring

Monitoring is a critical part of lifecycle management for any resource, and we are working hard to improve the monitoring experience for Azure Stream Analytics. Today we are excited to announce an improvement that makes it easier to manage and monitor your Azure Stream Analytics jobs. On the 1 hour Monitor view in the Azure portal, you will…

0