The main problem of the issue, was the CA0055 error i did get during the nightly build on TFS. Because it is a problem of a class library build by the build server of TFS, i do not have a 'calling' program like a .exe of a website. So I do not have any config file to set this.
Or i need to find the config file (or program) TFS uses to build the nightly builds. Becuase i could not find any file, i still got the error.
But... Finally i did find the solution. The problem occurred during code analysis, and did some searching on that. At one point i found the following post:
Code Analysis error Could not load file or assembly 'System.Net.Http, Version=2.0.0.0 in MVC4 Web API
The solution is to change the config file of FxCopCmd.exe in one or more places in the program files directory. I found two FxCopCmd.exe.config files, and changed the following setting to:
<add key="AssemblyReferenceResolveMode" value="StrongNameIgnoringVersion" />
And i did not get the error i got.