Cluster - kylessukaichang/kylessukaichang.github.io GitHub Wiki

• Parallel Computing
  • parallel algorithms with simple data dependencies
    • shared memory programming model
      • available on multicore systems
    • distributed memory programming model
      • available on HPC clusters.
• OpenMP(Open Multi-Processing)
  • The application programming interface (API) OpenMP (Open Multi-Processing) supports multi-platform shared-memory multiprocessing programming in C, C++, and Fortran, on many platforms, instruction-set architectures and operating systems, including Solaris, AIX, HP-UX, Linux, macOS, and Windows.
  • OpenMP: An IndustryStandard API for SharedMemory Programming
• MPI(Message Passing Interface)
  • Excerpt
    • Message Passing Interface (MPI) is a standardized and portable message-passing standard designed to function on parallel computing architectures. The MPI standard defines the syntax and semantics of library routines that are useful to a wide range of users writing portable message-passing programs in C, C++, and Fortran.
  • Implement
    • Open MPI
    • Intel MPI
    • [Microsoft MPI][10]
• Build a Raspberry Pi cluster computer
• Why build a Raspberry Pi Cluster?
• Shared Memory Clusters 101

[10]:https://docs.microsoft.com/en-us/message-passing-interface/microsoft-mpi