Commit Graph

276 Commits

Author SHA1 Message Date
2a8692c64f Fix integration test to hopefully work on Alpine (#430).
Some checks failed
continuous-integration/drone/push Build is failing
2021-07-25 22:50:00 -07:00
1709f57ff0 Fix hang when restoring a PostgreSQL "tar" format database dump (#430).
Some checks failed
continuous-integration/drone/push Build is failing
2021-07-25 22:30:15 -07:00
54d57e1349 Add test for #407: Fix syslog logging on FreeBSD. 2021-06-23 10:21:45 -07:00
27d37b606b Better error messages! Switch the library used for validating configuration files (from pykwalify to jsonschema).
All checks were successful
continuous-integration/drone/push Build is passing
2021-06-22 13:27:59 -07:00
cf8882f2bc Run arbitrary Borg commands with new "borgmatic borg" action (#425).
All checks were successful
continuous-integration/drone/push Build is passing
2021-06-17 20:41:44 -07:00
9fd28d2eed Fix error handling to error loudly when Borg gets killed due to running out of memory (#423)! 2021-06-08 11:43:55 -07:00
d6e376d32d Fix end-to-end test broken by change in source directory examples.
All checks were successful
continuous-integration/drone/push Build is passing
2021-04-18 17:54:54 -07:00
d543109ef4 "Fix" build failure with Alpine Edge by switching from Edge to Alpine 3.13.
All checks were successful
continuous-integration/drone/push Build is passing
2021-04-09 15:58:23 -07:00
4897a78fd3 Fix database tests broken by PostgreSQL upgrade in Alpine Edge.
All checks were successful
continuous-integration/drone/push Build is passing
2020-12-24 22:23:09 -08:00
ad7198ba66 Tweak to test failing on some machines.
All checks were successful
continuous-integration/drone/push Build is passing
2020-11-26 16:22:42 -08:00
c0ae01f5d5 Code formatting.
All checks were successful
continuous-integration/drone/push Build is passing
2020-11-25 17:46:57 -08:00
ccd1627175 Fix timing-related test error in Alpine Edge.
Some checks failed
continuous-integration/drone/push Build is failing
2020-11-25 15:48:33 -08:00
1f4f28b4dc Drop support for Python 3.5. Only support black code formatter on Python 3.8+.
Some checks failed
continuous-integration/drone/push Build is failing
2020-11-22 17:27:21 -08:00
ea6cd53067 Update versions of test dependencies (test_requirements.txt and test containers).
Some checks failed
continuous-integration/drone/push Build is failing
2020-11-22 14:48:07 -08:00
9b819f32f8 Fix traceback when upgrading old INI-style configuration with upgrade-borgmatic-config (#367).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2020-11-18 15:01:10 -08:00
b619bde037 Fix broken end-to-end test.
All checks were successful
continuous-integration/drone/push Build is passing
2020-11-18 14:20:07 -08:00
ebac02f118 Mention placeholders for repositories in documentation; fix #369 2020-11-18 20:22:41 +01:00
1ea04aedf0 Merge override values when specifying the "--override" flag multiple times (#361).
Some checks failed
continuous-integration/drone/push Build is failing
2020-10-23 16:06:00 -07:00
0e978299cf Fix traceback when a database hook value is null in a configuration file (#355).
All checks were successful
continuous-integration/drone/push Build is passing
2020-10-07 15:41:45 -07:00
3c723e8d99 Merge branch 'master' into master 2020-08-12 21:11:45 +00:00
72bd96c656 Fix traceback when a configuration directory is non-readable due to directory permissions (#350).
All checks were successful
continuous-integration/drone/push Build is passing
2020-08-12 11:32:00 -07:00
893fca2816 Add before_extract and after_extract hooks 2020-08-01 16:08:32 +02:00
b3fd1be5f6 Add "borgmatic export-tar" action to export an archive to a tar-formatted file or stream (#300).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2020-07-22 21:53:55 -07:00
6f82c9979b Add #339 to NEWS and add test.
All checks were successful
continuous-integration/drone/push Build is passing
2020-07-07 22:31:17 -07:00
37cc229749 Fix duplicate logging to Healthchecks and send "after_*" hooks output to Healthchecks (#328).
Some checks failed
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is failing
2020-06-23 11:01:03 -07:00
17c2d109e5 Add tests for pass-through of BORG_* environment variables.
All checks were successful
continuous-integration/drone/push Build is passing
2020-06-21 14:41:22 -07:00
32e15dc905 Add a few more mocks to PostgreSQL SSL tests.
All checks were successful
continuous-integration/drone/push Build is passing
2020-06-20 14:39:16 -07:00
f5ebca4907 Add SSL support to PostgreSQL database configuration (#331).
All checks were successful
continuous-integration/drone/push Build is passing
Reviewed-on: witten/borgmatic#331
2020-06-20 21:24:14 +00:00
d2d92b1f1a Add tests for the PostgreSQL SSL options 2020-06-20 23:32:24 +03:00
27cbe9dfc0 Fix for potential data loss (data not getting backed up) when borgmatic omitted configured source directories in certain situations (#333).
All checks were successful
continuous-integration/drone/push Build is passing
2020-06-19 20:16:38 -07:00
abd47fc14e Add SSL support to PostgreSQL hooks 2020-06-19 02:19:17 +03:00
7fb4061759 Improve configuration reference documentation readability via more aggressive word-wrapping in configuration schema descriptions.
All checks were successful
continuous-integration/drone/push Build is passing
2020-06-17 23:15:12 -07:00
aa14449857 Add "borgmatic extract --strip-components" flag to remove leading path components when extracting an archive (#324).
All checks were successful
continuous-integration/drone/push Build is passing
2020-06-06 14:57:14 -07:00
a155eefa23 Fix for certain configuration options like ssh_command impacting Borg invocations for separate configuration files (#323). 2020-06-06 14:30:04 -07:00
d7277893fb Fix hang when a stale database dump named pipe from an aborted borgmatic run remains on disk (#316).
All checks were successful
continuous-integration/drone/push Build is passing
2020-06-02 12:40:32 -07:00
097a09578a Fix enabled database hooks to implicitly set one_file_system configuration option to true to prevent Borg hang. (#315).
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-26 09:20:14 -07:00
65472c8de2 Fix error message when there are no MySQL databases to dump for "all" databases (#319).
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-26 08:59:04 -07:00
96df52ec50 Fix hang when streaming a database dump to Borg with implicit duplicate source directories by deduplicating them first (#316).
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-20 13:33:53 -07:00
89cb5eb76d Fix regression in support for PostgreSQL's "directory" dump format (#314).
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-18 11:31:29 -07:00
048a9ebb52 Add an additional end-to-end database test.
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2020-05-15 10:12:49 -07:00
3e5a19d95a Add missing test coverage.
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-14 23:21:43 -07:00
d88f321cef Fix legitimate database dump command errors (exit code 1) not being treated as errors by borgmatic (#310).
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-14 22:38:38 -07:00
15ea70a71b Flesh out missing test coverage for execute.py.
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-12 15:49:49 -07:00
8b91c01a4c Add some missing test coverage. 2020-05-11 11:34:14 -07:00
3bcef72050 Add some missing test mocks that were masking lack of unit coverage.
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-11 11:17:24 -07:00
695c764a01 Merge log output functions into one. 2020-05-11 10:55:50 -07:00
1ea047dd94 Remove "borgmatic restore --progress" flag, as it now conflicts with streaming database restores. 2020-05-09 21:53:16 -07:00
4b523f9e2c Make database restore output only show at verbosity 2.
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-08 19:38:33 -07:00
6a61070d85 Use shell redirection rather than the --file flag to sidestep synchronization issues when pg_dump/pg_dumpall tries to write to a named pipe.
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-08 19:11:26 -07:00
f36082938e Additional test coverage. 2020-05-08 09:48:04 -07:00
1ba996ad93 Additional test coverage.
Some checks reported errors
continuous-integration/drone/push Build encountered an error
2020-05-07 12:14:27 -07:00
a23fdf946d Stream database dumps and restores directly to/from Borg without using any additional filesystem space (#258).
Some checks reported errors
continuous-integration/drone/push Build encountered an error
2020-05-07 11:44:04 -07:00
12cf6913ef Remove unused function parameter.
All checks were successful
continuous-integration/drone/push Build is passing
2020-05-03 14:07:34 -07:00
e4eff0e3dc Bump version for release.
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2020-04-24 15:56:56 -07:00
dce1928dc4
Fix PostgreSQL restore error on "all" database dump. 2020-04-24 15:50:33 -07:00
Nathan Beals
3c8dc4929f Added test_restore_all_database_dump unit test.
Updated the other unit tests, as I had to re-arrange argument order
Added an 'all' test for the postgres end-to-end test.

Ran black formatter on it all.
2020-04-24 18:32:53 -04:00
e511014a28 Fix MySQL restore error on "all" database dump by excluding system tables (#301).
All checks were successful
continuous-integration/drone/push Build is passing
2020-04-22 12:17:22 -07:00
bae5f88824 Upgrade test database versions.
All checks were successful
continuous-integration/drone/push Build is passing
2020-04-21 10:01:26 -07:00
55141bda67 Specify "--archive latest" to all actions that accept an archive (#289). 2020-01-29 16:59:02 -08:00
bc02c123e6 Monitor backups with PagerDuty hook integration (#245).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2020-01-27 15:32:09 -08:00
e76d5ad988 Fix tests.
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-27 12:56:12 -08:00
2405e97c38 Backup to a removable drive or intermittent server via "soft failure" feature (#284).
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-24 20:52:48 -08:00
fdbb2ee905 View consistency check progress via "--progress" flag for "check" action (#287).
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-24 11:27:16 -08:00
94b9ef56be Change "exclude_if_present" option to support multiple filenames, rather than just a single filename (#280).
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-23 13:41:37 -08:00
53e6ff9524 No longer list files or show stats by default at verbosity 2.
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-22 15:23:49 -08:00
f66fd1caaa Customize Healthchecks log level via borgmatic "--monitoring-verbosity" flag (#277).
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-22 15:10:47 -08:00
d93fdbc5ad Support "--files" and "--stats" flags at verbosity level 0.
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-22 13:28:24 -08:00
palto42
75b5e7254e changes as per comments in PR #283 2020-01-22 19:03:26 +01:00
palto42
5f0c084bee Merge 'upstream/master' into list-files 2020-01-22 18:12:26 +01:00
7824a034ca Add test for database dump directory removal.
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-21 10:34:46 -08:00
palto42
e27ba0d08a less detail at v1 + option "--files" for details 2020-01-11 16:38:07 +01:00
d0c533555e In "borgmatic --help", don't expand $HOME in listing of default "--config" paths.
All checks were successful
continuous-integration/drone/push Build is passing
2020-01-02 10:37:31 -08:00
911668f0c8 Only trigger "on_error" hooks and monitoring failures for "prune", "create", and "check" actions, and not for other actions (#270).
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-20 13:58:02 -08:00
d64bcd5e83 When pruning with verbosity level 1, list pruned and kept archives.
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-17 20:12:41 -08:00
f787dfe809 Override particular configuration options from the command-line via "--override" flag (#268).
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-17 11:46:27 -08:00
e009bfeaa2 Update Healthchecks/Cronitor/Cronhub monitoring integrations to fire for "check" and "prune" actions, not just "create" (#249).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2019-12-12 22:54:45 -08:00
c6cb21a748 Switch to read-only container filesystem to avoid *.pyc getting created with busted permissions.
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2019-12-11 21:24:37 -08:00
464ff2fe96 Run end-to-end tests on developer machines with Docker Compose for approximate parity with continuous integration tests.
Some checks reported errors
continuous-integration/drone/push Build was killed
2019-12-11 16:43:01 -08:00
0cc711173a Merge branch 'master' into end-to-end-database-tests
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-11 12:27:14 -08:00
14e5cfc8f8 Support piping "borgmatic list" output to grep. Retain colored output when piping/redirecting (#271).
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-11 12:12:25 -08:00
68281339b7 Black.
Some checks failed
continuous-integration/drone/push Build is failing
2019-12-10 16:57:12 -08:00
01e2cf08d1 Fix Drone CI services syntax. 2019-12-10 16:43:43 -08:00
9f821862b7 End-to-end tests for database dump and restore. 2019-12-10 16:41:01 -08:00
8660af745e Optionally change the internal database dump path via "borgmatic_source_directory" option in location configuration section (#259).
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-10 16:04:34 -08:00
826e4352d1 Filter listed paths via "borgmatic list --path" flag (#269).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2019-12-08 14:07:02 -08:00
b94999bba4 Fix "borgmatic umount" so it only runs Borg once instead of once per repository / configuration file.
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-07 21:36:51 -08:00
65cc4c9429 Fix "--repository" flag to accept relative paths.
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-06 16:29:41 -08:00
df2be9620b Mount whole repositories via "borgmatic mount" without any "--archive" flag (#253).
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-06 15:58:54 -08:00
2ab9daaa0f Attempt to repair any inconsistencies found during a consistency check via "borgmatic check --repair" flag (#266).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2019-12-04 16:07:00 -08:00
0c6c61a272 Pass extra options directly to particular Borg commands, handy for Borg options that borgmatic does not yet support natively (#235).
All checks were successful
continuous-integration/drone/push Build is passing
2019-12-04 15:48:10 -08:00
00f62ca023 Fix for "before_backup" hook not triggering an error when the command contains "borg" and has an exit code of 1 (#256).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2019-11-30 16:55:05 -08:00
9b2ca15de6 Fix for garbled Borg file listing when using "borgmatic create --progress" with verbosity level 1 or 2 (#257).
All checks were successful
continuous-integration/drone/push Build is passing
2019-11-30 15:31:36 -08:00
c4aa34bf5c Fix for missing Healthchecks monitoring payload or HTTP 500 due to incorrect unicode encoding (#260).
All checks were successful
continuous-integration/drone/push Build is passing
2019-11-30 14:51:32 -08:00
d978a2d190 Fix for database dump removal incorrectly skipping some database dumps. 2019-11-25 15:27:59 -08:00
375036e409 Support for mounting an archive as a FUSE filesystem via "borgmatic mount" action, and unmounting via "borgmatic umount" (#123).
All checks were successful
continuous-integration/drone/push Build is passing
2019-11-25 14:56:20 -08:00
f4a231420f Show summary log errors regardless of verbosity. Log the "summary:" header with level based on the contained logs.
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2019-11-25 10:31:09 -08:00
55ebfdda39 Show full error logs at "--verbosity 0" so you can see command output without upping the verbosity level.
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2019-11-19 10:09:25 -08:00
2cc743cf47 With "borgmatic check", consider Borg warnings as errors (#247). 2019-11-17 19:06:28 -08:00
d99e6d1994 Remove obnoxious log message when Healthchecks hook sends failure for check action. 2019-11-17 18:55:40 -08:00
50f62d73b7 When using the Healthchecks monitoring hook, include borgmatic logs in the payloads for completion and failure pings (#241).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2019-11-17 16:54:27 -08:00