Hadoop Binary Streaming and F# MapReduce

As mentioned in my previous post Hadoop Streaming not only supports text streaming, but it also supports Binary Streaming. As such I wanted to put together a sample that supports processing Office documents; more on support for PDF in a later post. As always the code can be downloaded from: http://code.msdn.microsoft.com/Hadoop-Streaming-and-F-f2e76850 Putting together this sample…

0

MapReduce Tester: A Quick Word

In my previous post I talked a little about testing the Hadoop Streaming F# MapReduce code; but it is worth saying a few words about the tester application. The complete code for this blog post and the F# MapReduce code can be found at: http://code.msdn.microsoft.com/Hadoop-Streaming-and-F-f2e76850 As mentioned Unit Testing the individual map and Reduce functions…

0

Using Hadoop on Azure JS Console for Data Visualizations

In my last past I demonstrated a F# MapReduce program based on Hadoop Streaming. One thing that intrigued me was the possibility of using the JS Console for doing a quick visualization of the MapReduce output. So here is my first foray into the idea. From the last example the data output was: Android    (00:00:06, 12:54:39,…

1

Hadoop Streaming and F# MapReduce

And now for something completely different. As you may know Microsoft has recently announced plans for a Hadoop adoption for both Windows Server and Windows Azure. You can find out more about Hadoop and Windows Azure at Apache Hadoop-based Services for Windows Azure and Availability of Community Technology Preview (CTP) of Hadoop based Service on…

3

F# Project and Item Templates (revised)

Over the past few months I have posted up a few Project and Item Templates for F#. Here is a quick summary of those templates. The Project Templates include: WPF Project WinForms Application Console Application Windows Service F# Class Library These Project Templates install the following Item Templates: Class Disposable Class Interface Windows Form There…

0

F# WPF Project Template

This template is for a basic F# Windows Presentation Foundation (WPF) project. This template can be found on the Visual Studio Gallery: http://visualstudiogallery.msdn.microsoft.com/33dab4ce-62b8-419e-8072-92bc88556f78 When the template is installed you get the following template added to your F# folder when creating a new F# project: This template that defines the following project elements: MainWindow.fs: This is…

0

SQL Server Query Performance Analysis using DMVs

Continuing the TSQL theme I thought it would be worthwhile sharing some TSQL scripts that I have been using over the years for tuning SQL Server queries… From the development perspective I often have to perform an analysis of a database application. More often than not this entails looking at a running system and ensuring…

4

Adventures in TSQL: Using CTEs when performing DELETE/UPDATE operations

It seems in quite a few applications of late there has been the requirement to batch process, in a distinct order, a series of entries from a table; namely a processing queue. Without delving in broker services this is easily managed using standard TSQL. The requirement is to delete a predefined number of entries from…

0

Adventures in TSQL: Adding date and time values

With the addition of the SQL Server date and time types, I have often found myself needing to create a datetime (or datetime2) value based on the addition of a date and a time value. However, there is no built-in function for such an operation. There are a few solutions to this problem that encompass…

3

Adventures in TSQL: Comma separated string from column values

It seems that several times now I have had the requirement to create a comma separated string from column values. The latest reason for doing this was to build up a list of table column names such that a view could be generated for the table. This is surprisingly easy to do in TSQL. One…

2