The default Rebus configuration, according to the error handling wiki, should move a poison message to the error queue. It is not happening in a situation where a third party component is causing a stackoverflow exception. The underlying queue is msmq, so the poison message abort counter is incremented.
Is this behavior because the application exception/exit is causing Rebus to lose its tracking? Either using in-memory counting for failed messages or exit before accounting for the message.