What is the suggested way to cron-automate ZODB packs for a production Plone instance?

Question

Looking at plone.org to find a way to periodically pack my instance's ZODB I could only find http://plone.org/documentation/faq/how-do-i-pack-the-zodb that doesn't talk about automated packs, but just manually initiated ones.

I know I can simulate the manual pack with wget or curl, but I'd like to know if that is the best practice in use for production sites.

score 23 · Accepted Answer · answered Mar 14 '11 at 16:05

If you are using ZEO you can add the following to your Crontab to do this:

0 1 * * 6 <path-to-buildout>/bin/zeopack

If you don't want to do it manually, add this to your buildout.cfg and the crontab entry above will be added automatically when you run bin/buildout:

parts += crontab_zeopack

# pack your ZODB each Sunday morning and hence make it smaller and faster
[crontab_zeopack]
recipe = z3c.recipe.usercrontab
times = 0 1 * * 6
command = ${buildout:directory}/bin/zeopack

I really think zeo should be the default: it has too many advantages over non-zeo setups. Thanks for the hint about z3c.recipe.usercrontab. — silviot, Mar 16 '11 at 14:10

score 6 · Answer 2 · answered Mar 15 '11 at 09:21

6

If you do not use ZEO:

curl -X POST -d 'days:float=0' http://admin:admin@localhost:8080/Control_Panel/Database/main/manage_pack

answered Mar 15 '11 at 09:21

chrigl

61
2

aclark · Answer 3 · 2013-09-10T13:42:38.213

5

I do it like this (from https://raw.github.com/plock/pins/master/zeo):

[backup]
recipe = collective.recipe.backup

# Backup daily
[backups]
recipe = z3c.recipe.usercrontab
times = 0 0 * * * 
command = ${buildout:bin-directory}/bin/backup

# Pack once a month
[packups]
recipe = z3c.recipe.usercrontab
times = 0 0 1 * * 
command = ${buildout:bin-directory}/bin/zeopack

edited Sep 10 '13 at 13:42

answered Apr 07 '11 at 00:32

aclark

4,345
1
19
31

score 2 · Answer 4 · answered Apr 14 '12 at 20:59

2

Use zeopack for ZEO (see other answers), and zodbpack for RelStorage (included, see RelStorage docs). Both are easy to set up.

answered Apr 14 '12 at 20:59

sdupton

1,869
10
9

score 2 · Answer 5 · answered Apr 05 '11 at 17:51

2

You may want to check out collective.migrator. It has a pack_db recipe among others.

answered Apr 05 '11 at 17:51

sureshvv

4,234
1
26
32

score 1 · Answer 6 · answered Mar 15 '11 at 17:53

1

For a python/urllib solution, see: http://www.zope.org/Documentation/Books/ZopeBook/2_6Edition/MaintainingZope.stx

#!/usr/bin/python
import sys, urllib
host = sys.argv[1]
days = sys.argv[2]
url = "%s/Control_Panel/Database/manage_pack?days:float=%s" % \
      (host, days)
try: 
    f = urllib.urlopen(url).read()
except IOError:
    print "Cannot open URL %s, aborting" % url
print "Successfully packed ZODB on host %s" % host

answered Mar 15 '11 at 17:53

ccrownhart

25
5

1

The URL is wrong for modern Zope installations, it should be at least .../Database/main/manage_pack?... or have other database name as per your instance configuration. – myroslav Mar 17 '11 at 11:49

score 0 · Answer 7 · answered Apr 14 '12 at 19:20

0

wget -O/dev/null -q --post-data='days:float=10' --user=adminuser --password=password http://localhost:PORT//Control_Panel/Database/main/manage_pack

If you prefer wget.

answered Apr 14 '12 at 19:20

GregD

741
7
15

What is the suggested way to cron-automate ZODB packs for a production Plone instance?

7 Answers7

Linked