Winsock I/O Model – Part I : Concept

Winsock I/O Model – Part I : Concept The basic steps to do windows socket programming are simple and straightforward: Server Side   Initialize Winsock. Create a socket. Bind the socket. Listen on the socket for a client. Accept a connection from a client. Receive and Send data. Disconnect. Client Side   Initialize Winsock. Create…

4

Parallel Database for OLTP and OLAP

Parallel Database for OLTP and OLAP Just a survey article on materials on parallel database products and technologies for OLTP/OLAP applications. It mainly covers major commercial/academic efforts on developing parallel dbms to solve the ever growing large amount of relational data processing problem.   Part I – Parallel DBMSs 1.1 Parallel Database for OLAP (Shared-Nothing/MPP)…

3

How to Read Source Code

Part I – General Steps and Principles 1. Define a Clear Goal- what’s the purpose? to know how, to own components, to modify and extend?- results driven, what’s the final outcome?2. Know it as Client User- read user manual- get an overall big picture- know what it can do and what can’t- what is it…

2

Database Technologies for Decision Support System

Database Technologies for Decision Support System Database technologies can be applied into two types of scenarios:- Transaction Processing(OLTP)- Analytic Processing, using statistical method(OLAP) or machine/computational learning method(Data Mining)OLTP, which is based on E.F. Codd’s relation model, is the traditional (maybe most popular) application type of DBMS and most people are very familiar with it. This…

1

Parallel Programming – Using MPI

Parallel Programming – Using MPI MPI is a message passing programming model standards[2], it defines various Terms/Concepts, Data Structures and Function Signatures that are used to passing messages among computer processes.1. Terms and ConceptsA MPI application consists of multiple Processes(Tasks), each has a unique identifier called Rank. A Process belongs to some Groups and some…

1

Scalability in Online Game and Virtual World

The latest issue of ACM Queue Magazine has an article titled “Scaling in Games & Virtual Worlds”, which talks about SUN’s efforts on the scalability problem in Online Game and Virtual World systems(A.K.A. MMORPG).The author is a Distinguished Engineer in SUN, who had been involved in the scalable online game platform: DarkStar for about 2…

1

Winsock I/O Model – Part II : Implementation

Winsock I/O Model – Part II : Implementation In the previous post[6], I summarized several scalable network I/O models in theory. In this article, I will give concrete code to show how to use each model to build a scalable network server. Building scalable server is a challenging task and needs a lot of considerations,…

1

Programming Windows Hpc Server – Using SOA Model

Conventionally, HPC/Parallel problems can be roughly divided into the following two categories[1][2]:- Data Parallel, these applications divides the input data into a number of completely independent parts. The same computation is undertaken on each part. And some kind of post processing after the computations is needed.- Task Parallel, these are those jobs that its functionality…

1

An Introduction to Windows HPC Server 2008

1. Components of Windows HPC Server1.1 X64 Windows OS (Windows Server 2008 Standard, Enterprise or Hpc Edition)1.2 Hpc Subsystem (Hpc Pack 2008)- scalable Job Scheduler for creation, execution and monitoring Hpc jobs- MS-MPI programming infrastructure, which is based on MPICH2- HPC-WCF(HPC-SOA) programming infrastructure- utilities for Cluster Managing (Configuring, Provisioning, Monitoring, Reporting and Diagnosing)Note: Hpc Pack…

1

Windows, Unix and ANSI C API Comparison

  The “Windows System Programming”(3E) has a great appendix about Windows, Unix, C Library API comparison. It’s obvious that this appendix lacks of many APIs in Memory, DLL and Security related areas, but it is still very helpful for referencing when doing system programming on windows platform.   Original content can be found here: http://my.safaribooksonline.com/0321256190/app021. I/O1. 1…

1