It doesn't affect performance at runtime at all.
It will probably increase compile-time very slightly since:
1) The compiler needs to parse a few more characters
2) It has to look up identifiers among more candidates. But since this probably uses hashtables it shouldn't be expensive either.
I'd guess the compiler slowdown is negligible.
I'd guess it slows Intellisense down a bit more since the list it has to display and filter gets quite a bit longer.
Removing unused usings is more a stylistic than a performance improvement. And you need to be careful about extension methods since they are brought into scope by using statements. For example I don't remove using System.Linq
even when it's currently unused.