So: I got a new Mac. I went to the developer provisioning portal, then revoked my certificate. I created a new one.
Now whenever I open XCode it complains that I have duplicate developer certificates. And yes, when I check with Keychain, there are two. I then delete the oldest one, but XCode is apparently very much in love with the old one: It keeps recreating it.
What to do?