Code coverage in Java with EclEmma not scanning expecting exception methods

Question

I'm trying to get my code coverage in java, using Eclipse and EclEmma.

My tests are using JUnit 4 and I've got some tests looking like this :

    @Test(expected = IllegalArgumentException.class)
    public void createTime_withInvalidMinuteUnder0_throws(){
    //Arrange
    ...
    //Act
    Something triggering IllegalArgumentException Here       
}

And EclEmma says that the test fails because there's an IllegalArgumentException being thrown. So it drops my code coverage indicator even though it's supposed to throw something. Is there an option to make it see that JUnit expected exception tag ?

edit: I've found out that if you add the throw to the declaration of the test aswell, it works!

score 21 · Accepted Answer · edited Jun 20 '20 at 09:12

21

No, there is no way to get EclEmma to notice the expected clause. They acknowledge this fact here.

Why are JUnit4 test cases with expected exceptions shown as not covered?

JUnit4 test cases with expected exceptions are shown as not covered even though they were executed. The reason for this is that underlying JaCoCo code coverage library only considers code as executed when certain probes are executed. For successful test cases marked with @Test{expected=...} this is not the case.

Personally, I wouldn't worry too much about it. Coverage of test cases is the least interesting thing EclEmma can tell you; I always completely ignore those metrics and focus on the coverage of my production code.

edited Jun 20 '20 at 09:12

Community

1
1

answered Oct 06 '12 at 07:39

Duncan Jones

67,400
29
193
254

4

What are more interesting things EclEmma can tell me? – Pacane Oct 06 '12 at 07:42
1

I was referring to the code coverage metrics for your production code, rather than your test code. Or did I misunderstand your original question? – Duncan Jones Oct 06 '12 at 07:46
Oh, my bad, I misunderstood your statement in your answer. – Pacane Oct 06 '12 at 07:51
Your tests does have to be covered, just exception cases are not covered by eclemma. – Diego Faria Jan 30 '14 at 15:59

score 5 · Answer 2 · edited Sep 02 '23 at 03:47

Can't comment yet, but I wanted to point out, in relation to the accepted answer, that there's a very good reason to pay attention to coverage of your test code.

It's just way too easy with JUnit to screw up the test method naming convention or forget the @Test annotation (depending on your JUnit version). Do that, and you could easily be fooled into thinking that your solid green bar means that the nice test you just added passed, when in fact it never ran. Coverage coloring will show this very prominently. Except of course, as this thread points out, some of your tests that throw exceptions might look like they didn't run when they did.

score 0 · Answer 3 · answered Jan 06 '15 at 14:13

I faced the same issue, and offered a pull request dealing with the most prominent cause of this annoyance. Instead of adding way too many probes, I only deal with the opcodes of method invocations. In other words, the problem of (previously) wrong coverage results caused by an exception thrown by a method invocation is solved, but not if the exception is thrown by, for example, a division by zero, a wrong cast, or an array index problem.

https://github.com/jacoco/jacoco/pull/261

Feel free to comment on the pull request or participate in the discussion I started on the JaCoCo mailing list.

Code coverage in Java with EclEmma not scanning expecting exception methods

3 Answers3

Linked