7

I need to select code coverage tool between Bullseye and MS code coverage tool. I found some positive feedback for Bullseye, and I can use MS code coverage tool free. The price for Bullseye is not that much ($800/1copy for buying, and $100/1copy+1year for later years), so it will not be a problem of licensing some copies of Bullseye.

However, if MS code coverage tool can give whatever Bullseye gives, I (my company) don't need to spend unnecessary money, and if Bullseye is better than MS tools in terms of easy of use, tool integration or whatever, I'm willing to pay for Bullseye.

We'll using gtest for unit test, so the easy of integration with gtest should be a big factor for decision. We also use TFS(Team Foundation Server), so again integration with TFS can be another factor.

We develop cross-platform code, but for code coverage, we consider only Windows environment. The code is implemented with C++.

What do you think? Can you share your experience of using MS code coverage tool or Bullseye?

Daniel Mann
  • 57,011
  • 13
  • 100
  • 120
prosseek
  • 182,215
  • 215
  • 566
  • 871
  • Since this post was originally made, the price was increased to $900 to buy and $200 per year to review. – AJM Jun 29 '22 at 10:44
  • The MS code coverage tool link is out of date. Here's an archive link: https://web.archive.org/web/20110131085307/http://blogs.msdn.com/b/ms_joc/archive/2005/04/08/406608.aspx - I will try to edit it in when the queues are not full. – AJM Jun 29 '22 at 10:46

3 Answers3

3

Bullseye, is so much easier to use than the MS tool. To get the MS tool to work, is painful, especially for hundreds of projects you have to build.

C.J.
  • 15,637
  • 9
  • 61
  • 77
2

I am using Bullseye, and it is ok. Nothing spectacular, but it does the job fine. The problem is if you don't have enough licences or to setup a floating licence.

But I found other tools (testcocoon and bcov), which are free and do the same thing.

btw I am on linux, if that matters.

BЈовић
  • 62,405
  • 41
  • 173
  • 273
  • bcov latest version is from 2009 and testcocoon is no longer maintained either. testcocoon has a commercial fork which is not free (unless for private use or open source). – ChrisWue Apr 19 '13 at 02:54
1

I used both, and to my understanding MS code coverage support for native C++ is quite limited. It does not work out-of-the-box, see for example this and the full details here.
I would use Bullseye for C++ and MS code coverage or NCover for .net code.

Uri Cohen
  • 3,488
  • 1
  • 29
  • 46
  • Archive URL for first link: https://web.archive.org/web/20200729031411/https://learn.microsoft.com/en-us/archive/blogs/cellfish/native-c-code-coverage-reports-using-visual-studio-2008-team-system – AJM Jun 29 '22 at 10:49
  • Archive URL for the second link: https://web.archive.org/web/20111013172015/http://blogs.msdn.com/b/ms_joc/archive/2005/04/08/406608.aspx – AJM Jun 29 '22 at 10:50