High Performance Computing

Thomas Sterling is Professor of Informatics and Computing at Indiana University. He serves as the Executive Associate Director of the Center for Research in Extreme Scale Technologies (CREST) and as its Chief Scientist. He is most widely known for his pioneering work in commodity cluster computing as leader of the Beowulf Project for which he and colleagues were awarded the Gordon Bell Prize. Professor Sterling currently leads a team of researchers at IU to enable a new generation of extreme scale computing systems and applications. He is the co-author of six books and holds six patents. He has taught a graduate level course upon which this textbook will be heavily informed, five times. Maciej Brodowicz is Advanced Parallel Computing Engineer at the Center for Research in Extreme Scale Technologies (CREST) at Indiana University. Matthew Anderson works in the Department of English at the University of New England, Maine, USA.

1. Introduction2. HPC Architecture3. Commodity Clusters4. Benchmarking5. The Essential Moab6. SMP7. The Essential OpenMP8. The Essential MPI9. Parallel Algorithms10. Libraries11. Operating Systems12. Scientific Visualization13. Performance Monitoring14. Debugging15. Accelerators16. Essential OpenACC17. Mass Storage18. File Systems19. Map Reduce20. Checkpointing21. Beyond (Next Steps)

Appendices: Essential CLinux User Interface