Parallel and Distributed Programming (PADP)

Lecture slides and material

• Introduction and OpenMP
• Lecture 1: Slides
• GPGPU
• Lecture 1: Slides
• Lecture 2: Slides Example Lab assignment 1 Lab assignment 2
• Lecture 3: Slides
• Lecture 4: Slides
• CUDA Reference Manual
• CUDA Programming Guide
• CUDA Best Practices Guide
• Prefix Sums and Their Applications
• Thrust - template library of CUDA algorithms and sort example
Lectures on GPGPU are based on materials by David Kirk, Wen-mei W. Hwu and John Stratton, NVIDIA/University of Illinois
• MPI
  • Lecture 1: Slides and examples
  • Lecture 2: Slides and examples
  • Lecture 3: Slides and examples Jacobi method example Solving Laplace equation analytically
• PETSc
  • Lecture 1: Slides and examples
  • Brief Introduction to Krylov Space Methods for Solving Linear Systems by Martin H. Gutknecht
• ICE
  • Lecture 1: Slides
  • Lecture 2: Slides
  • Lecture 3: Slides
  • Lecture 4: Slides
• CORBA
  • Lecture 1: Slides Example 1
  • Lecture 2: Slides Example 2
  • Lecture 3: Slides
  • Lecture 4: Slides
  • C++ Language Mapping Specification
• Threads, synchronization, inter-process communication
• Lecture 1: Slides
• Lecture 2: Slides
• Lecture 3: Slides
• Lecture 4: Slides
• Lecture 5: Slides

Recommended reading

1. M. Herlihy, N. Shavit, "The Art of Multiprocessor Programming", Morgan Kaufmann Publishers, 2008
2. B. CHapman, G. Jost, R van der Pas, "Using OpenMP", The MIT Press, 2008
3. M. Henning, S. Vinoski: Advanced CORBA Programming with C++, Addison-Wesley 1999