StreamInsight: Creating a LINQPad data context

This blog post is for those folks comfortable with creating a data stream from an IEnumerable, IObservable or StreamInsight adapter data source.  If you’d like more details on creating those, have a look at this blog post, which covers creating an IEnumerable ‘canned’ data source then wrapping a LINQPad context around it. Creating a data…


StreamInsight Query Patterns: Fun with process data – calculating the wind chill factor

Process data, commonly accessed from OPC or a process historian such as OSIsoft PI, is well suited for analysis using StreamInsight – being time-series data with data values from a range of sensors.  In this post, I’ll walk through a couple of simple patterns for working with process data (not that these patterns are isolated…


StreamInsight: Reading from other data contexts into StreamInsight with LINQPad

The LINQPad driver for StreamInsight provides an awesomely easy way to run StreamInsight queries using easily accessible data contexts of temporal streams.  However, as LINQPad only supports a single active data context connection in a query it can be difficult to use one of the hard to read “without a data context” sources (such as…


StreamInsight: Where did that query result come from (using the Event Flow Debugger in LINQPad)?

Occasionally, when working with StreamInsight queries an unusual result will crop up, leading to asking the rather blunt question “where did that come from?”.  Luckily the StreamInsight Event Flow Debugger has a great feature (Root Cause Analysis) that will let us examine how certain results were generated. If you’ve never used the Event Flow Debugger,…


StreamInsight: Understanding dynamic query composition

Been tied up with PASS for the past (pun intended) couple of weeks, so it’s time to get a bit caught up on writing.  One of the key technical features of StreamInsight is the ability for one query to consume the output of another, enabling the system to avoid having to process events twice, and…


StreamInsight V1.1 is released (.NET Sequences / IObservable, side-by-side installation and perf improvements)

The StreamInsight dev team has just released the next version of StreamInsight (version 1.1)!!  New features in this release include: .NET Sequences – no more custom adapters for common .NET data sources.  Using .NET sequences instead of adapters as event sources and sinks, which makes the integration with many existing data sources much easier and…


StreamInsight: Getting started with using the (Event Flow) debugger, viewing diagnostics, and exposing the management service.

StreamInsight has a very powerful management service that is fully available to developers and administrators alike.  Any technique that you see in the Event Flow Debugger or in the API can be remotely invoked via the Management Service.  This enables all sorts of tasks and scenarios, such as remotely deploying queries to a live server,…


StreamInsight and reference data (lists, databases, etc)

Using reference data in StreamInsight is a very common scenarios; some examples would be: Monitoring process control event streams for values that exceed a given threshold (for example, a valve’s pressure exceeding a certain safety threshold). Enriching utility usage information in a smart metering scenario with user and geography information (for example, to allow visualization…


StreamInsight: Synchronizing slow-moving reference streams with fast-moving data streams (time import)

One of the common tasks in StreamInsight is to use a reference stream to integrate metadata or reference data from a relatively static source (such as a SQL Server table – a walkthrough of this technique will be described in an upcoming blog post).  One of the challenges in integrating the reference stream has to…


101’ish LINQ Samples for StreamInsight (part 1 – filtering and aggregation)

Following in the great tradition of other learn through example LINQ example pages, such as 101 LINQ Samples, here’s the first in a series of posts on StreamInsight query examples.  This will first show up on this blog, then get migrated over to a centralized site on the StreamInsight developer center.  We’ve got a fairly…