High Performance Computing

Thomas Sterling is Professor of Informatics and Computing at Indiana University. He serves as the Executive Associate Director of the Center for Research in Extreme Scale Technologies (CREST) and as its Chief Scientist. He is most widely known for his pioneering work in commodity cluster computing as leader of the Beowulf Project for which he and colleagues were awarded the Gordon Bell Prize. Professor Sterling currently leads a team of researchers at IU to enable a new generation of extreme scale computing systems and applications. He is the co-author of six books and holds six patents. He has taught a graduate level course upon which this textbook will be heavily informed, five times. Maciej Brodowicz is Advanced Parallel Computing Engineer at the Center for Research in Extreme Scale Technologies (CREST) at Indiana University. Matthew Anderson works in the Department of English at the University of New England, Maine, USA.

1. Introduction 2. HPC Architecture 3. Commodity Clusters 4. Benchmarking 5. The Essential Moab 6. SMP 7. The Essential OpenMP 8. The Essential MPI 9. Parallel Algorithms 10. Libraries 11. Operating Systems 12. Scientific Visualization 13. Performance Monitoring 14. Debugging 15. Accelerators 16. Essential OpenACC 17. Mass Storage 18. File Systems 19. Map Reduce 20. Checkpointing 21. Beyond (Next Steps) Appendices: Essential C Linux User Interface