Just read the The World According to LINQ article in October’s Communications of the ACM – Erik Meijer does a really good job describing LINQ and how it can be used with Big Data from my different data sources – ie. DBs, REST services and other unstructured data sources…also describes the mathematical foundations of LINQ….
Big data is about more than size, and LINQ is more than up to the task.
Programmers building Web- and cloud-based applications wire together data from many different sources such as sensors, social networks, user interfaces, spreadsheets, and stock tickers. Most of this data does not fit in the closed and clean world of traditional relational databases. it is too big, unstructured, denormalized, and streaming in real time. Presenting a unified programming model across all these disparate data models and query languages seems impossible at first. By focusing on the commonalities instead of thee differences, however, most data sources will accept some form of computation to filter and transform collections of data.
Erik Meijer. 2011. The world according to LINQ. Commun. ACM 54, 10 (October 2011), 45-51. DOI=10.1145/2001269.2001285 http://doi.acm.org/10.1145/2001269.2001285