Yes, each comment that you write will make the compilation slower, because the compiler has to read more text. But: reading comments is very easy for a compiler, and it is quickly done, so you should not worry about it.
You can try it out yourself. Make a program that generates some simple source code with lots of comments in it.
int i = 0;
...
i++; /* This is a comment, and maybe a very long one. */
...
Now you can experiment with making this (generated) comment very long, possibly even megabytes. Then measure the difference when compiling the code with small and large comments, and you will see that the speed is still acceptable.