4

I've got one project in development. I use mysql and ActiveRecord. It looks like this project is good one to start using MongoDB (which I've never used) with Mongoid adapter.

What is the best way to move my project to Mongo? As I understand I should edit my models (not a big deal) and that's all?

How can I export my data from Mysql database to Mongo? I've just tried yaml_db but it doesn't help me.

And second question is how should I keep safe my Mongo database if my system crashes (as I understand Mongo will loose data as far as it stores data in RAM). My db is 10%/90% write/read.

Community
  • 1
  • 1
fl00r
  • 82,987
  • 33
  • 217
  • 237
  • 3
    1. looks like my data more fit Document ideology; 2. educational reason; 3. this project is not critical on data safe so I can do this experiment – fl00r Mar 17 '11 at 11:32

4 Answers4

7

I have done something similar recently and approached it as a 3 step process. There may be a more Rails way of doing this, but this way worked for me and was painless.

I used an iterative approach and took advantage of the fact that MongoDB is actually a very relational friendly document storage system. I started with a relational setup using Mongoid's Relational Associations (bottom of page) syntax of references_many and referenced_in. Once things were working I refactored iteratively into a more document oriented approach.

1. Dump the existing database straight to MongoDB

I used my existing models to brute force dump the SQL tables and data into parallel MongoDB documents. I just slammed everything I had into them without worrying about naming or relationships; a strict 1:1 mapping of tables to collections.

This was a one time process for me. Once everything is here steps 2 and 3 takes this data and transforms it into the structure that I wanted. I could also change my models as I no longer needed to interact with the relational system. You may want to create some sort of copy of the existing models in case you need to go back to this step for any reason.

2. Migrate the data

For the next step I went with a custom ruby shell app. Again there may be a better way to do this with Rails features, but I went with a straight forward transaction script style approach.

I used the raw MongoDB Ruby driver, read the database created in step 1, and transformed the source collections into the shapes that I wanted. I used a separate database for the destination from the one created in step 1 because I iteratively modified this script to become more and more document oriented as I refactored my model in step 3.

3. Refactor models as needed

I refactored my model to run against the database created in step 2, made my tests pass, and then went back to the script in step 2 and made changes to make the database more document oriented.

I iterated over steps 2 and 3 until I had refactored my model and document layouts until I had a final result.

blu
  • 12,905
  • 20
  • 70
  • 106
3

Re: your second question

1.8.0 now supports single server durability, through the addition of journaling (see docs here). That states, when you use journaling, mongo will issue batch commits every 100ms (will be more frequent in future versions). Once it's in the journal, if it crashes, it can then come back up and recover. You can request that a call into Mongo does not return until it's committed safely (at the expensive of a slight performance hit), or if using replica sets you can state how many nodes a change should be replicated to before returning - so you can make sure it's been replicated to a majority/all of the nodes.

AdaTheDev
  • 142,592
  • 28
  • 206
  • 200
1

The others answered your second question, migrating from MySQL to MongoDB depends on what your data looks like though. There is no automatic tool that will convert the database. You will likely want to simply write your own conversion script.

I'd suggest simply dumping one model into YAML as you've tried, convert that model to use Mongoid, then read the YAML and re-create the objects.

If you have complex relational data though, MongoDB might not be what are looking for anyway. Read up on the differences between key-value stores and relational databases.

There is a popular question that covers just that: When to use MongoDB or other document oriented database systems?

Community
  • 1
  • 1
fx_
  • 1,932
  • 13
  • 17
  • I've read this question few days ago. I understand that I can simplify my database, throw out some joins so I want to try Mongo. – fl00r Mar 17 '11 at 12:14
  • If you really just want to try out MongoDB, just write something new. I actually did the same thing, to try out Mongoid, a while ago: [wrote my own url shortening service](http://blog.impaled.org/2011/3/9/write-your-own-url-shortening-service-seriously.html) – fx_ Mar 17 '11 at 12:24
0

Diff is that you have facility of embedded object. Use it in your models. Also you can use Event Sourcing to protect from crash.

Andrew Orsich
  • 52,935
  • 16
  • 139
  • 134
Andrei Andrushkevich
  • 9,905
  • 4
  • 31
  • 42