Parallel Database for OLTP and OLAP

Parallel Database for OLTP and OLAP Just a survey article on materials on parallel database products and technologies for OLTP/OLAP applications. It mainly covers major commercial/academic efforts on developing parallel dbms to solve the ever growing large amount of relational data processing problem.   Part I – Parallel DBMSs 1.1 Parallel Database for OLAP (Shared-Nothing/MPP)…

3

Database Technologies for Decision Support System

Database Technologies for Decision Support System Database technologies can be applied into two types of scenarios:- Transaction Processing(OLTP)- Analytic Processing, using statistical method(OLAP) or machine/computational learning method(Data Mining)OLTP, which is based on E.F. Codd’s relation model, is the traditional (maybe most popular) application type of DBMS and most people are very familiar with it. This…

1

Parallel Programming – Using PVM

Parallel Programming – Using PVM PVM is an inactive direction in HPC community, but there are many lessons can be learned from its programming model, its architecture design/implementation and how/why it failed to be the dominate system. Part I – What’s PVM?PVM (Parallel Virtual Machine) is a software framework for heterogeneous parallel computing in networked…


Parallel Programming – Using MPI

Parallel Programming – Using MPI MPI is a message passing programming model standards[2], it defines various Terms/Concepts, Data Structures and Function Signatures that are used to passing messages among computer processes.1. Terms and ConceptsA MPI application consists of multiple Processes(Tasks), each has a unique identifier called Rank. A Process belongs to some Groups and some…

1

Parallel Programming – Using OpenMP

Parallel Programming – Using OpenMP OpenMP is a parallel programming model for shared memory parallel computers.It’s based on Fork-Join parallel execution pattern and is suitable for Data Parallel and Task Parallel applications.Fork-Join Pattern- OpenMP programs begin as a single thread – the Master thread, which executes sequentially until the first parallel region construct is encountered.-…


Parallel Programming – Using POSIX Threads

Parallel Programming – Using POSIX Threads Pthreads (a.k.a POSIX Threads), is another parallel programming model over Shared Memory Computers, which is categorized to Threads Based Model (the other is message passing based model).Pthreads provides Threads by means of pure C style APIs, while OpenMP does it through language compiler directives.As the Process/Thread concepts are very…


Parallel Computing – An Introduction

Parallel Computing – An Introduction Parallel Computing is a form of computation in which many calculations are carried out simultaneously, operating on the principle that large problems can often be divided into smaller ones, which are then solved concurrently (“in parallel”). The core motivation for parallelizing is speeding up computing tasks.1. Types of ParallelismThere are…


Map/Reduce – in Functional Programming & Parallel Processing Perspectives

Map/Reduce – in Functional Programming & Parallel Processing Perspectives Map/Reduce is a very popular term pair in today’s technical community, mainly due to the popularity of its “inventor” – Google.But in fact, the terms and concepts of map & reduce exist in programming language community long before G company’s successful paper “MapReduce: Simplified Data Processing…


Parallel DBMS V.S. Distributed DBMS

Parallel DBMS V.S. Distributed DBMS  Large Scale Data Intensive Computing is a hot topic today, many people starts to talk so called Parallel Database System and Distributed Database System technologies. But these two concepts seem very confusing, so I devoted sometime to try to make it clear.Parallel Database System seeks to improve performance through parallelization…