[Picture: emblem]

Parallel Programming

Parallel Programming is activity of the PARALLEL TEMPUS project.

Available kind of materials:


    [Document(HTML)] Preface

  1. [Document(ps.gz)] [Transparencies(ps.gz)] Introduction to Parallel Processing by Péter Kacsuk
    Document (42 pages Gzipped Postscript 427k, Zipped Winword 287k)
    Transparencies (61 slides Gzipped Postscript 301k, Zipped Winword 282k)
    1. Basic concepts
    2. Types and levels of parallelism
    3. Classification of parallel architectures
    4. Parallel techniques
    5. Relationships between languages and parallel architectures
    6. The Sieve of Eratosthenes
    7. Speedup, Amdahl's Law
    8. Data Parallel Approach with I/O
  2. [Document(ps.gz)] [Transparencies(ppt)] Computational Models
    Document (42 pages Gzipped Postscript 153k, Zipped Winword 131k) by Dezső Sima
    Transparencies (Zipped PowerPoint 83k) by Péter Broczkó
    1. The notion of computational model
    2. The Turing computational model
    3. The von Neumann computational model
    4. The dataflow model of computation
    5. The applicative model of computation
    6. Predicate logic based computational model
    7. The object based computational model
    8. A summary of the basic computational models
  3. [Document(ps.gz)] [Transparencies(ps.gz)] Shared-Memory Programming by Péter Kacsuk
    Document (19 pages Gzipped Postscript 412k, Zipped Winword 291k)
    Transparencies (8 slides Gzipped Postscript 21k, Zipped Winword 12k)
    1. Introduction
    2. A Shared-Memory Process Model
    3. Analysis of shared-memory programs
    4. Monitors
    5. Summary
  4. [Document(ps.gz)] [Transparencies(ps.gz)] Distributed-Memory Programming: Occam by Péter Broczkó
    Document (36 pages Gzipped Postscript 105k, Zipped Winword 50k)
    Transparencies (46 slides Gzipped Postscript 60k, Zipped Winword 30k)
    1. Introduction
    2. The conception of Communicating Sequential Processes (CSP)
    3. The programming language occam, based on CSP
    4. References
    5. Futher reading
  5. [Document(ps.gz)] [Transparencies(ps.gz)] MPI: The Message Passing Interface by Gábor Dózsa
    Document (29 pages Gzipped Postscript 136k, Zipped Winword 62k)
    Transparencies (34 slides Gzipped Postscript 48k, Zipped Winword 31k)
    1. The Message Passing Paradigm
    2. What Is MPI?
    3. General Aspects of MPI
    4. Point-to-Point Communication
    5. Six Function MPI
    6. More on Point-to-Point Communication
    7. Derived Data Types
    8. Collective Communication
    9. Convenient Process Naming : Virtual Topologies
    10. Topics not included
    11. The future of MPI
  6. [Document(ps.gz)] [Transparencies(ps.gz)] Object Oriented Parallel Programming Languages by Tamás Máray
    Document (27 pages Gzipped Postscript 104k, Zipped Winword 47k)
    Transparencies (28 slides Gzipped Postscript 594k, Zipped PowerPoint 15k)
    Abstract (HTML)
    1. Introduction
    2. Parallel and concurrent programming
    3. Object Oriented Paradigm
    4. Object orientation and parallelism
    5. Fundamental problems - inheritence anomalies
    6. Requirements for Object Oriented Parallel Programming Languages
    7. Introducing parallelism to object oriented systems
    8. The CC++ language
    9. Parallel programming, using Java
  7. [Document(ps.gz)] [Transparencies(ps.gz)] Parallel Execution Models of Declarative Languages by Zsolt Németh
    Document (30 pages Gzipped Postscript 152k, Zipped Winword 121k)
    Transparencies (40 slides Gzipped Postscript 152k, Zipped Winword 258k)
    Abstract (HTML)
    1. Imperative and declarative languages
    2. Logic programming
    3. Functional programming
  8. [Document(ps.gz)] [Transparencies(ps.gz)] Parallel Programming Tools and Environments by Gábor Dózsa
    Document (32 pages Gzipped Postscript 229k, Zipped Winword 125k)
    Transparencies (33 slides Gzipped Postscript 334k, Zipped Winword 182k)>
    1. Introduction
    2. Specification of Parallel Algorithms
    3. Mapping and Dynamic Load Balancing
    4. Debugging of Parallel Programs
    5. Performance Analysis
    6. Monitoring
  9. Literature
Obsolete documents related to this activity.

Additional materials

[Document(ps.gz)] [Transparencies(ps.gz)] Programming of PVM by Imre Szeberényi
Document in Hungarian (35 pages Gzipped Postscript 170k)
Transparencies (20 slides Gzipped Postscript 135k)
Transparencies in hand out format (4 slides Gzipped Postscript 39k)
Transparencies with notes (20 slides Gzipped Postscript 126k)

[Document(HTML)] [Document(ps.gz)] GRAPNEL programming environment by Dániel Drótos
Document (HTML, 133 pages Gzipped Postscript 140k)
Abstract (HTML)

A Short Course in Parallel Scientific Computing by Graham Horton

  1. [Transparencies(ps.gz)] Introduction to Parallel Scientific Computing (24 slides Gzipped Postscript 102k)
  2. [Transparencies(ps.gz)] Fundamentals of Parallel Computing (19 slides Gzipped Postscript 137k)
  3. [Transparencies(ps.gz)] Solution of elliptic PDEs (25 slides Gzipped Postscript 150k)
  4. [Transparencies(ps.gz)] Ordinary Differential Equations (18 slides Gzipped Postscript 135k)
  5. [Transparencies(ps.gz)] Eigenvalue Computations (19 slides Gzipped Postscript 133k)
  6. [Transparencies(ps.gz)] Load Balancing (19 slides Gzipped Postscript 112k)
  7. [Transparencies(ps.gz)] Exercise 1: Parallel numerical approximation of PI (1 slide Gzipped Postscript 7k)
  8. [Transparencies(ps.gz)] Exercise 2: Parallel solution of a PDE with the Jacobi and Gaus-Seidel methods (1 slide Gzipped Postscript 7k)
  9. [Transparencies(ps.gz)] Exercise 3: Parallel integration of an ordinary differential equation (1 slide Gzipped Postscript 8k)

[Document(HTML)] Introduction To Parallel Programming Languages and Occam by George R. R. Justo
Document (HTML)