Memory management when converting redis keys

Question

I need to convert keys from type string to hash. The name of all keys is in the set list:of:keys.

My current implementation looks like this:

var rdbc = require("redis").createClient(6379, '127.0.0.1');
rdbc.smembers("list:of:keys", function(err, strings){
    strings.forEach(function(string, index, strings){
        rdbc.get(string, function(err, result){
            rdbc.del(string);
            rdbc.hset(string, "foo", result);
        });
    });
});

My attempt works. But when list:of:keys contains many values memory usage grows a lot.

Are there memory efficient structures to go through many keys? (especially strings.forEach(… seems inefficient)
How do I inform the garbage collector in node.js to clean up after each rdbc.del/rbdc.hset operation?

Welcome to Stackoverflow. You did good work on writing your first question. — TheHippo, Jun 15 '12 at 16:55

score 0 · Accepted Answer · edited May 23 '17 at 12:21

0

I don't know how the redis driver for node.js handles this, but if they are clever they use some the cursors redis offers to loop through the results. This means the do not fetch all results at the beginning, they fetch them when you access them.
The garbage collection is handled by the V8 (the underlying JavaScript engine of node.js) There is plenty of documentation on how it works (just search for "Garbage Collection V8"):

edited May 23 '17 at 12:21

Community

1
1

answered Jun 15 '12 at 16:52

TheHippo

61,720
15
75
100

Thanks! I am going to read into the garbage collection and try to keep my strings-array small. – Christian Kintner Jun 15 '12 at 16:58

Memory management when converting redis keys

1 Answers1