28-01-2011, 02:45 PM
Rajkumar Buyya
School of Computer Science and Software Engineering
Monash Technology
Melbourne, Australia
Objectives
Explain the parallel computing right from architecture, OS, programming paradigm, and applications
Explain the multithreading paradigm, and all aspects of how to use it in an application
Cover all basic MT concepts
Explore issues related to MT
Contrast Solaris, POSIX, Java threads
Look at the APIs in detail
Examine some Solaris, POSIX, and Java code examples
Debate on: MPP and Cluster Computing
Agenda
Overview of Computing
Operating Systems Issues
Threads Basics
Multithreading with Solaris and POSIX threads
Multithreading in Java
Distributed Computing
Grand Challenges
Solaris, POSIX, and Java example code
History of Parallel Processing
PP can be traced to a tablet dated around 100 BC.
Tablet has 3 calculating positions.
Infer that multiple positions:
Reliability/ Speed
Motivating Factors
Just as we learned to fly, not by constructing a machine that flaps its wings like birds, but by applying aerodynamics principles demonstrated by nature...
We modeled PP after those of biological species.
Aggregated speed with
which complex calculations
carried out by individual neurons
response is slow (ms) - demonstrate
feasibility of PP
Computation requirements are ever increasing -- visualization, distributed databases, simulations, scientific prediction (earthquake), etc..
Sequential architectures reaching physical limitation (speed of light, thermodynamics)
Why Parallel Processing?
The Tech. of PP is mature and can be exploited commercially; significant R & D work on development of tools & environment.
Significant development in Networking technology is paving a way for heterogeneous computing.
Hardware improvements like Pipelining, Superscalar, etc., are non-scalable and requires sophisticated Compiler Technology.
Vector Processing works well for certain kind of problems.