In my own experience, using Selenium-Webdriver 2.45.0 and Firefox v 35.0 will work. If you have a newer version of Firefox installed, it must be removed first. If you're running on MacOS, you will likely have to disable auto-updates within Firefox before you can rollback to v 35.0 (they're enabled by default, and begin immediately when you open Firefox...).
Capybara/Cucumber version shouldn't matter as long as everything else is set correctly (it's just loading a driver anyway).
https://ftp.mozilla.org/pub/mozilla.org/firefox/releases/
Btw, don't ever use 'bundle update' or 'gem update' arbitrarily. That's like saying "give me the newest versions of all gems from all available sources" without knowing the effects beforehand. It can be a Pandora's Box of trouble if you aren't careful, especially 'bundle update'.