1

By the link is written: https://docs.nvidia.com/deploy/pdf/CUDA_Multi_Process_Service_Overview.pdf

1.1. AT A GLANCE

1.1.1. MPS

The Multi-Process Service (MPS) is an alternative, binary-compatible implementation of the CUDA Application Programming Interface (API). The MPS runtime architecture is designed to transparently enable co-operative multi-process CUDA applications, typically MPI jobs, to utilize Hyper-Q capabilities on the latest NVIDIA (Kepler-based) Tesla and Quadro GPUs. Hyper-Q allows CUDA kernels to be processed concurrently on the same GPU; this can benefit performance when the GPU compute capacity is underutilized by a single application process.

  1. Do I have to use the MPS (MULTI-PROCESS SERVICE) when using CUDA6.5 + MPI (OpenMPI / IntelMPI), or can I not use MPS with lost some performance but without any errors?

  2. If I will not use MPS, does it mean that all my MPI-processes on a single server will execute their GPU-kernel-functions sequentially (not concurrent) on a single GPU-card, but all other behavior will stay the same?

Alex
  • 12,578
  • 15
  • 99
  • 195

1 Answers1

5

  1. MPS is not required to use MPI

  2. If you don't use MPS, but you launch multiple MPI ranks per node (i.e. per GPU), then if you have the compute mode set to default, then your GPU activity will serialize. If you have your compute mode set to EXCLUSIVE_PROCESS or EXCLUSIVE_THREAD, you'll get errors when multiple MPI ranks attempt to use a single GPU.

CUDA MPS documentation is available here.

Robert Crovella
  • 143,785
  • 11
  • 213
  • 257
  • Thank you very much! But, do I have to launch MPS-daemon **before my application** will launched, or do I have to launch MPS-daemon **from my application**, or MPS-daemon will **started automatically** when I have launched my app? – Alex Sep 08 '14 at 06:37
  • 2
    You must launch the daemon before your run. – Levi Barnes Sep 08 '14 at 12:16
  • @Levi Barnes But do I have to launch MPS-daemon by using **nvidia-cuda-mps-control** or by using **nvidia-cuda-mps-server**? – Alex Sep 08 '14 at 16:40
  • 1
    You may want to read the [documentation](https://docs.nvidia.com/deploy/pdf/CUDA_Multi_Process_Service_Overview.pdf) in particular section 4.1.2 – Robert Crovella Sep 08 '14 at 16:48