I have reading this answer that says, it makes sites load slower.
Pretty much all* browsers will support 4096-bit keys. The issue you'll run into is that key exchange is slower with larger keys, which will increase load on the server and slow down page loading on the client.
I recently installed a 4096-bit certificate and like to know some real word numbers and benchmarks to know if this was a bad decision.