Questions tagged [test-runner]

187 questions
171
votes
46 answers

Visual Studio 2015 or 2017 does not discover unit tests

EDIT 2016-10-19: The original question was about an issue specific to VS2015 CTP6 with the XUnit test runner. It's clear from the answers that there is a much broader issue with unit test discovery in Visual Studio which may occur in many different…
70
votes
8 answers

No tasks available when executing JUnit runner class

I am trying to run Cucumber feature files in IntelliJ. Cucumber Options is pointing to the right folder, but I get the "No tasks available" notification when trying to execute the JUnit runner class. What am I doing wrong? Here is my…
Mate Mrše
  • 7,997
  • 10
  • 40
  • 77
40
votes
5 answers

JetBrains Resharper 9 Ultimate Test Runner error: NUnit.Core.UnsupportedFrameworkException: Skipped loading assembly {MyAssembly}

This seems to be an error with the JetBrains Resharper 9.1 Ultimate Test Runner referencing an older version of NUnit. I am using NUnit 3.0 in my assembly. [Window Title] Unit Test Runner [Main Instruction] Unit Test Runner failed to run…
Pouya Barrach-Yousefi
  • 1,207
  • 1
  • 13
  • 27
27
votes
2 answers

Cannot resolve ActivityTestRule after upgrading dependencies. Unable to import ActivityTestRule

I have written instrumentation tests which was working fine, but now getting error cannot resolve ActivityTestRule error after upgrading dependencies to androidTestImplementation 'com.android.support.test:runner:1.0.2' androidTestImplementation…
24
votes
4 answers

How can I continuously run unit tests in Visual Studio 2012 Professional?

Visual Studio 2012 added a "Run tests after build" button in the Unit Test Explorer, but it seems that option is not available in the Professional edition. In fact, my "Unit Test Explorer" is just called "Test Explorer", and doesn't have that button…
Brant Bobby
  • 14,956
  • 14
  • 78
  • 115
22
votes
7 answers

What is the best Nunit test runner out there?

Having recently gotten into test driven development I am using the Nunit test runner shipped as part of resharper. It has some downsides in terms of there is no shortcut to run tests and I have to go looking for the Nunit test runner to invoke it…
anonym0use
  • 2,936
  • 4
  • 25
  • 26
19
votes
2 answers

What are the security risks of using Gitlab CI shared test runners?

I am trying to host a new project with Gitlab. It is a private Python project. I was able to test some initial tests with Gitlab CI. I don't use cache while running tests, While exploring the runner section in settings, there is a warning…
user5170375
18
votes
2 answers

Run each JUnit Test with a Separate ClassLoader (no, really)

How can I have JUnit use a separate ClassLoader for each test class it executes? I am writing a JUnit TestRunner for a library that sets a lot of static variables. I essentially want to reset all of these between each test class, without needing to…
DeejUK
  • 12,891
  • 19
  • 89
  • 169
15
votes
2 answers

Get @CucumberOptions tag property using System.getProperty()

I am running a maven project in Eclipse for my Cucumber tests. My test runner class looks like this: @RunWith(Cucumber.class) @CucumberOptions( tags = { "@Now" }, // tags = { "@Ready" }, // tags = { "@Draft" }, …
Charlie S
  • 4,366
  • 6
  • 59
  • 97
14
votes
3 answers

Can't run Xunit tests on Visual Studio 2017

Can't run all the XUnit tests on my Visual Studio 2017. Version 15.6.4 They can be viewed in TestExploer and when I run them from there I get something like this: [27.03.2018 12:21:46 Informational] ------ Load Playlist started ------ [27.03.2018…
Rostyslav Fedyk
  • 307
  • 1
  • 3
  • 10
12
votes
1 answer

Using mocha with resharper

Is there a testrunner for resharper that allows me to run my nodejs mocha tests? I personally use Wallaby.js within visual studio, but at the office we only have resharper licenses. I can get NTVS to run the tests with the standard visual studio…
Ken
  • 365
  • 2
  • 7
12
votes
2 answers

Forcing nunit console runner to use CLR 4.5

I have the following simple test case: var uri = new Uri("http://foo.com/bar%2Fbaz"); Assert.AreEqual("http://foo.com/bar%2Fbaz", uri.AbsoluteUri); This test fails on .NET 4 but passes on .NET 4.5, I can test this using ReSharper test runner which…
huseyint
  • 14,953
  • 15
  • 56
  • 78
12
votes
1 answer

Creating a Full Haskell Stack with Tests

I'm new to Haskell and I'm trying to structure a program under test. I have decided to use HUnit and Cabal. From what I have seen a well strucutred project looks the following: src/ AppName/ Appname.hs testsuite/ tests/ AppName/ …
GTDev
  • 5,488
  • 9
  • 49
  • 84
9
votes
1 answer

Is there test explorer in intellij idea? (to observe all the tests without execution)? I use TestNG

In VS and Resharper I could see all test in my solution before any execution, see https://www.jetbrains.com/help/resharper/Reference__Windows__Unit_Test_Explorer.html In Idea I can't find any test explorer, only test runner but it slightly…
Tatiana
  • 381
  • 4
  • 18
9
votes
2 answers

Parallel test runner for play framework

Functional tests involving the TestServer class of the Play Framework seem to work only inside the Play console. Unfortunately the stock test runner in the Play console executed by the play test command executes the tests in sequence and that takes…
Tamas
  • 3,254
  • 4
  • 29
  • 51
1
2 3
12 13