Asynchronous cuBLAS calls

Question

I want to make calls to cuBLAS routines asynchronously. Is it possible? If yes, how can I achieve that?

score 11 · Accepted Answer · answered Sep 25 '12 at 11:40

11

Use the cublasSetStream function before the cublas calls.

cublasSetStream(cublasHandle, cudaStream);

answered Sep 25 '12 at 11:40

sgarizvi

But I am not using the handle in any of my gemv and gemm calls so will it work then also? – user1439690 Sep 26 '12 at 02:34
1

In the new cublas api this function was changed to `cublasSetKernelStream(cudaStream)` – sgarizvi Sep 26 '12 at 05:22
It's not clear looking at documentation if you only need a single non-default stream or if you should use a stream for each computation you want to happen asynchronously. – Michael Conlen Apr 04 '13 at 15:21
1

The function is now simply `cublasSetStream(handle, streamId)` – una_dinosauria Jul 15 '15 at 21:50

1 Answers1