I'm not sure what ended up fixing it, but I closed Visual Studio and opened up developer tools, and ran devenv /SafeMode
which starts it with no extensions installed. I then navigated and opened up the solution in the instance and it worked. It complained about source control bindings and removed those (This solution used to be in a TFS project and now it's in a git tfs project). Then after saving it and closing visual studio I was able to re-open the solution from file explorer.
I'm not sure if it was the devenv or the source control bindings that fixed it, or just restarting visual studio for the umpteenth time, but it appears to work now.