9

I am aware RabbitMQ is written in Erlang and thus can't be embedded in a JVM like we would do with the ActiveMQ JMS broker for exemple.

But actually there are some projects that are done in another language and that can easily be embedded for integration tests.

For exemple, MongoDB, written in C++, can be easily started/stopped in the context of a JVM integration test with: https://github.com/flapdoodle-oss/embedmongo.flapdoodle.de

There is also someone porting it to Java: https://github.com/thiloplanz/jmockmongo/

So I just wonder how can we do integration tests when my application is written in Java, and the other technology is in another langage (like Erlang for RabbitMQ)?

In general what are the good practices?

I see 3 main solutions:

  • Starting a real RabbitMQ
  • Embedding a JVM port of the technology in the currently used Langage
  • Use standard technologies so that a technology in Erlang may have the same behavior and communication layer that another one in Java (RabbitMQ / Qpid / StormMQ implementing AMQP)

Is there a Maven/Sbt/Ant plugin to startup a temporary RabbitMQ broker? Any project to support Junit/TestNG RabbitMQ before a test class?

I have seen that there is an opensource implementation of AMQP in Java: Apache Qpid Has someone any experience using this implementation for integration testing while in production there is RabbitMQ? Is it even possible? I am using Spring Integration.

By the way, I just noticed that the Spring-AMQP project mention on its github readme:

Many of the "integration" tests here require a running RabbitMQ server - they will be skipped if the broker is not detected.

Sebastien Lorber
  • 89,644
  • 67
  • 288
  • 419
  • My experience using Apache Qpid from within another JVM project was certainly disappointing. While it IS possible to start Apache Qpid this way, it was NOT designed to work like this. QPid, at runtime, reconfigured the whole application Logging framework (SLF4J + Logback) to suit its own needs and wasn't easy to revert this change. In our case, we were heavily relying on RabbitMQ's extensions so it didn't make sense pursuing this avenue anymore. – Alejandro Sep 12 '16 at 14:48

5 Answers5

3

If it were me, I would look at mocking the stack component in question. What's the best mock framework for Java? (although not a great Stack Overflow question) and Mock Object might help get you going.

Mocking the components makes testing much easier (IMHO) than trying to "live test" everything.

Community
  • 1
  • 1
Mark Leighton Fisher
  • 5,609
  • 2
  • 18
  • 29
  • We already use mocking (btw I work with a Mockito commiter). This integration test is aimed to check that the integration works. So if I use mocks, this part is not tested anymore. I'd like to check my broken configuration works fine with my application too, and not just the application behavior. – Sebastien Lorber Apr 21 '13 at 09:48
3

In the past I have used a virtual machine that had a fresh install of RabbitMQ running. Developers would run it constantly and our CI server would start a new VM for each revision of the code. Our tests would fail if they could not connect to the server instead of skipping the tests as a lack of integration tests is a serious problem.

This tends to work reasonably well and prevents needing to start and stop RabbitMQ for the tests. Our tests were split up to use vhosts for isolation and a few calls to create vhosts on demand so we could parallelize tests is we needed to.

Philip Cristiano
  • 904
  • 5
  • 11
  • Nice idea. How much time does it take to spawn that VM with a RabbitMQ? – Sebastien Lorber Apr 22 '13 at 16:27
  • With Vagrant and the basebox cached it takes under 5 minutes, it was a bit of a problem on the CI machine so it is rebuilt after the tests run to be left waiting for the next code push. With proper management of vhosts it should be possible to leave it running for the CI server and just rebuild it overnight. – Philip Cristiano Apr 23 '13 at 10:40
  • I saw there is a maven vagrant plugin. Need to try it. http://nicoulaj.github.io/vagrant-maven-plugin/examples/running-a-vm-during-integration-tests.html Thanks this seems to be the best way to use – Sebastien Lorber Apr 25 '13 at 09:08
  • I've accepted my own answer here: http://stackoverflow.com/a/24919210/82609 because using Docker seems to me more appropriate than using VMs finally – Sebastien Lorber Jul 23 '14 at 19:32
2

I will tell you my opinion on the Apache QPid vs Rabbit MQ as I worked with both. My opinion is that they do 'extend' AMQP, but are very different. If in production you will have Rabbit MQ, then use the same one in tests - also the same version, patches, fixes, etc. There are things that Apache Qpid can do and Rabbit MQ can not and vice-versa.

Stating the obvious integration tests are done so that you could test the integration of the application. I would start an instance of Rabbit MQ.

Eugene
  • 117,005
  • 15
  • 201
  • 306
  • Yeas that's right. Btw it seems RabbitMQ an AMQP 0.9.1 broker but Qpid is 1.0... – Sebastien Lorber Apr 23 '13 at 15:14
  • I would also start an instance of RabbitMQ, but for automated/CI tests how do you start it? I would like to have some maven plugin for the pre-integration-test phase which spawns a fresh new RabbitMQ server and shuts it down after the tests – Sebastien Lorber Apr 23 '13 at 15:15
2

Based on Philip Christiano's answer that says to use VM's, now we have Docker and I think it is the way to go to embed different technologies in docker containers.

One can start a docker container containing a RabbitMQ server, and it will be faster than using VM's because docker containers are lightweight and startup time is a lot better.

There are some maven plugins that permit to start docker containers, for exemple: http://www.alexecollins.com/content/docker-maven-plugin/

Sebastien Lorber
  • 89,644
  • 67
  • 288
  • 419
1

Since I was in your exact same situation and couldn't find a good solution, I developed it myself (inspired by Embedded-Redis, Embedded-Mongo, etc.)

This library is a wrapper around the process of downloading, extracting, starting and managing RabbitMQ so it can work like an embedded service controlled by any JVM project.

Check it out: https://github.com/AlejandroRivera/embedded-rabbitmq

It's as simple as:

EmbeddedRabbitMqConfig config = new EmbeddedRabbitMqConfig.Builder()
    .version(PredefinedVersion.V3_5_7)
    // ...
    .build();
EmbeddedRabbitMq rabbitMq = new EmbeddedRabbitMq(config);
rabbitMq.start();
...
rabbitMq.stop();

Works on Linux, Mac and Windows.

Alejandro
  • 635
  • 1
  • 6
  • 16