Skip to content

Commit

Permalink
Merge 2.0dev branch
Browse files Browse the repository at this point in the history
* add azurite test case
* remove support for pgBackRest under 2.32
* improve ignore-archived- and skip unneeded boundary wal on TL switch
  • Loading branch information
pgstef authored Feb 10, 2021
1 parent 7bf8a02 commit 3be4bad
Show file tree
Hide file tree
Showing 31 changed files with 665 additions and 937 deletions.
3 changes: 2 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,5 @@
tests/common/perf/nytprof*
vagrant.yml
tests/common/configuration.profile
_old.*
_old.*
*.rpm
10 changes: 9 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,18 @@ Changelog

2020-xx-xx v2.0:

- Only support pgBackRest **2.28** and above in order to only use its internal
commands. This remove Perl dependencies no-longer needed to reach repository
hosts or S3 compatible object stores.
This also brings Azure compatible object stores support.
- Support non-gz compressed files in the archives check (Magnus Hagander).
- Fix the `ignore-archived-*` features when using pgBackRest internal commands
(Magnus Hagander).
- ...
- Improve `ignore-archived-*` features to skip WAL consistency check for backups
involving ignored archives.
- Skip unneeded boundary WAL check on TL switch (reported by sebastienruiz).
- The retention service will now check that at least the backup directory exists,
not only trusting the pgBackRest info command output (suggested by Michael Banck).

2020-07-28 v1.9:

Expand Down
38 changes: 0 additions & 38 deletions INSTALL.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,41 +35,3 @@ To install check_pgbackrest using the PGDG repositories (located in `/usr/bin`):
```
apt-get -y install check-pgbackrest
```

The packages provided in the PGDG repositories (RPM or DEB) don't install
specific modules for SFTP or Amazon S3 compatibility. See below which modules
to install manually.

-----

## Remote check using SFTP

To list archived WALs using SFTP, you need to install the following module:

- On RedHat-like: `perl-Net-SFTP-Foreign`
- On Debian-like: `libnet-sftp-foreign-perl`

-----

## Amazon S3 compatibility

To handle the S3 connection, two modules are needed:

- On RedHat-like: `perl-Config-IniFiles` and `perl-Net-Amazon-S3`
- On Debian-like: `libconfig-inifiles-perl` and `libnet-amazon-s3-perl`

Unfortunately, the `perl-Net-Amazon-S3` (on CentOS 7) can, for the time being,
only be found in the Open Fusion repositories. To install it on CentOS 7, use:

```
yum install -y http://repo.openfusion.net/centos7-x86_64/\
openfusion-release-0.7-1.of.el7.noarch.rpm
```

-----

## Unneeded Perl dependencies with pgBackRest >= 2.28

Using the `--enable-internal-pgbr-cmds` argument will use pgBackRest internal
commands. SFTP or Amazon S3 specific Perl dependencies are then not needed
anymore.
15 changes: 1 addition & 14 deletions README
Original file line number Diff line number Diff line change
Expand Up @@ -66,17 +66,6 @@ DESCRIPTION
Check if all archived WALs exist between the oldest and the latest
WAL needed for the recovery.

This service requires the "--repo-path" argument to specify where
the archived WALs are stored.

The "--repo-host" and "--repo-host-user" arguments allow to list
remote archived WALs using SFTP.

The "--repo-s3" enables remote archived WALs stored in Amazon S3.

The "--repo-s3-over-http" switch to HTTP connection instead of
HTTPS.

Archives must be compressed. If needed, use "compress-level=0"
instead of "compress=n".

Expand Down Expand Up @@ -116,9 +105,7 @@ DESCRIPTION
Use the "--extended-check" argument to force a full check of the
found archives and raise warnings in case of inconsistencies.

After pgBackRest 2.28, it is possible to use the "repo-ls" and
"repo-get" internal commands with the "--enable-internal-pgbr-cmds"
argument to list and get the content of files in the repository.
This service only support pgBackRest 2.28 and above.

check_pgb_version
Check if this script is running a given version.
Expand Down
14 changes: 1 addition & 13 deletions README.pod
Original file line number Diff line number Diff line change
Expand Up @@ -87,16 +87,6 @@ Arguments are not mandatory to only show some information.
Check if all archived WALs exist between the oldest and the latest
WAL needed for the recovery.

This service requires the C<--repo-path> argument to specify where
the archived WALs are stored.

The C<--repo-host> and C<--repo-host-user> arguments allow to list
remote archived WALs using SFTP.

The C<--repo-s3> enables remote archived WALs stored in Amazon S3.

The C<--repo-s3-over-http> switch to HTTP connection instead of HTTPS.

Archives must be compressed. If needed, use "compress-level=0"
instead of "compress=n".

Expand Down Expand Up @@ -136,9 +126,7 @@ are ignored.
Use the C<--extended-check> argument to force a full check of the found
archives and raise warnings in case of inconsistencies.

After pgBackRest 2.28, it is possible to use the C<repo-ls> and C<repo-get>
internal commands with the C<--enable-internal-pgbr-cmds> argument to list and
get the content of files in the repository.
This service only support pgBackRest 2.28 and above.

=item B<check_pgb_version>

Expand Down
Loading

0 comments on commit 3be4bad

Please sign in to comment.