Questions tagged [opt]

When I try to use DeepSpeed example to finetune a OPT 1.3b model on my local machine, I have an unexpected error, which related to following code snippet: template __global__ void moe_res_matmul(T* residual, T* coef, T* mlp_out, int…

I am having problem with running LLVM custom passes on the ".ll" file of a CUDA code. For example, I have a CUDA sample code named sample1.cu. I have compiled the CUDA code using the following command. ./bin/clang++ -flegacy-pass-manager -g -Xclang…