Questions tagged [pgbackrest]

pgBackRest aims to be a reliable, easy-to-use backup and restore solution that can seamlessly scale up to the largest databases and workloads by utilizing algorithms that are optimized for database-specific requirements.

pgBackRest is a way to get reliable scalable backup and restore of PostgreSQL databases. It has several features including:

  • Parallel Backup & Restore using algorithms like lz4 and zstd.
  • Local or Remote Operation using a custom protocol; can use TLS/SSH with minimal configuration
  • Multiple Repositories allow, for example, a local repository with minimal retention for fast restores and a remote repository with a longer retention for redundancy
  • Full, Incremental, & Differential Backups which are not susceptible to the time resolution issues of rsync
  • Backup Rotation & Archive Expiration; the WAL archive can be maintained for all backups or strictly for the most recent backups
  • Backup Integrity where checksums are calculated for every file in the backup and rechecked during a restore or verify
  • Page Checksums can validate the checksums for every file that is copied during a backup
  • Backup Resume from the point where it was stopped
  • Streaming Compression & Checksums while files are being copied to the repository
  • Delta Restore to speed processing enormously
  • Parallel, Asynchronous WAL Push & Get
  • Tablespace & Link Support are fully supported and on restore tablespaces can be remapped to any location
  • S3, Azure, and GCS Compatible Object Store Support
  • Encryption
  • Compatibility with ten versions of PostgreSQL
27 questions
3
votes
2 answers

how to get a max per group and subgroup using jq

jq is an amazing tool and it does a lot. as input I have [ { "backup": [ { "timestamp": { "start": 1642144383, "stop": 1642144386 }, "info": { "size": 1200934840}, "type": "full" }, { …
user123664
3
votes
1 answer

Difference between incremental backup and WAL archiving with PgBackRest

As far as I understood WAL archiving is pushing the WAL logs to a storage place as the WAL files are generated Incremental backup is pushing all the WAL files created since the last backup So, assuming my WAL archiving is setup correctly Why…
Patanouk
  • 111
  • 8
2
votes
1 answer

PostgreSQL: even read access changes data files disk leading to large incremental backups using pgbackrest

We are using pgbackrest to backup our database to Amazon S3. We do full backups once a week and an incremental backup every other day. Size of our database is around 1TB, a full backup is around 600GB and an incremental backup is also around…
cdaller
  • 63
  • 6
2
votes
1 answer

CRITICAL: system ID mismatch, node belongs to a different cluster: 6859654378827691778 != 6859654951670505099

i installed a patroni master node and need to create a pgbackrest replica the master node state is running but the slave node is stopped then it disappear because it looks like it belongs to another database identifier, when i try to run restore…
rabeb soltani
  • 41
  • 1
  • 3
1
vote
0 answers

Check backup schedule in PGO

I'm using a PGO maintained, backup enabled Postgres cluster running on K8. The backups are supposed to be scheduled but I'm not sure where to check for the backup schedule configuration. I have tried several ways such as below commands as I found…
1
vote
0 answers

Restore backups to postgres instance on another server through pgbackrest

I'm trying to backup/restore from one postgres instance on one virtual machine to another postgres on another vm. How to give paths in…
1
vote
0 answers

Why is pgbackrest not expiring old straggling incremental backups

version pgBackRest 2.19 (this is old, so I might just need to update) We have pgbackrest set to retain the last 14 backups, and when I run pgbackrest --stanza=main info | grep 'backup:' | sort I see the last 14 full backups, but also many…
swagrov
  • 1,510
  • 3
  • 22
  • 38
1
vote
1 answer

Unusally large incremental backups with pbbackrest

I'm doing daily full backups of postgres database (v12.2) and hourly incremental backups with pgbackrest (v2.24) and crontab. After an out-of-disk hickup (and after an event where a lot of activity was going on in the DB) I started investigating the…
simonescu
  • 462
  • 5
  • 17
1
vote
2 answers

pgo: Where does the schedule of scheduled backups get saved

Using Postgres Operator for pgo_create_schedule with the below command: pgo create schedule --schedule="15 10 * * *" --schedule-type=pgbackrest --pgbackrest-backup-type=full mycluster Where the the cron style schedule end up? I dont see it on the…
1
vote
1 answer

ERROR: [062]: stop file exists for stanza test

I created a stanza named 'test', then i delete it and tried to recreate it with the same name i got an error stop file exists for stanza test even when i try to stop pgbackrest i get a warn stop file exists for stanza test Any help please ? Thank…
rabeb soltani
  • 41
  • 1
  • 3
1
vote
1 answer

restore specific db issue using pgbackrest

I have a question about how to backup a specific Database using pgbackrest: the problem is when I tried to restore a selected db using --include-db option of pgbackrest i got just the selected db and built-in databases(postgres, template0 and…
rabeb soltani
  • 41
  • 1
  • 3
1
vote
1 answer

How to exclude a particular table in postgres backup using pgbackrest?

Trying to exclude a particular table alone during postgres backup. Is there something similar in pgbackrest like pg_dump pg_dump --exclude-table-data=ex_table demodb
gokul goku
  • 13
  • 2
0
votes
0 answers

pgBackRest not compatible with EDB Advanced Server 12

PostgreSQL : EDB Advanced Server 12.15.19 pgBackRest 2.43 OS: RHEL 9 Build a binary using rhel9 but getting below issue pg_basebackup: error: incompatible server version 12.15.19 pg_basebackup: removing data directory "/data/enterprisedb/12" Can…
aman chhabra
  • 45
  • 1
  • 6
0
votes
0 answers

Postgresql Database cant start after restore using pgBackRest

I am doing backup with pgbackrest in the database server every day at night, I was testing to restore the backup in another server, the restore was successfully however the database cant start pgbackrest --stanza=data --delta…
Deo Felix
  • 1
  • 1
0
votes
0 answers

Postgres point-in-time restore issue with pgbackrest

I use pgbackrest 2.43 for postgresql 14.6 database backup and restore, I got a strange issue for point-in-time recovery. Below are steps I followed to perform the test. (1) First run a full database backup with pgbackrest. pgbackrest --stanza=db1…
Eric
  • 11
  • 2
1
2