328 Commits

Author	SHA1	Message	Date
Divyansh Singh	e83ad9e1e4	use repository["path"] instead of repository	2023-03-25 01:04:57 +05:30
Dan Helfman	f42890430c	Add code style plugins to enforce use of Python f-strings and prevent single-letter variables.	2023-03-23 23:11:14 -07:00
Divyansh Singh	6f300b0079	feat: constants support	2023-03-24 02:39:37 +05:30
Divyansh Singh	7a2f287918	reformat base	2023-03-23 01:08:30 +05:30
Divyansh Singh	8a63c49498	feat: tag repos	2023-03-23 01:01:26 +05:30
Divyansh Singh	39ad8f64c4	add tests and remove magic number	2023-03-21 17:06:03 +05:30
Divyansh Singh	e86d223bbf	Merge branch 'master' of https://github.com/diivi/borgmatic into feat/file-urls-support	2023-03-21 16:55:05 +05:30
Divyansh Singh	58c95d8015	feat: file:// URLs support	2023-03-20 02:43:23 +05:30
Dan Helfman	b115fb2fbe	Merge branch 'master' of github.com:borgmatic-collective/borgmatic	2023-03-18 14:01:52 -07:00
Dan Helfman	31d04d9ee3	Optionally error if a source directory does not exist. ... feat: add optional check for existence of source directories	2023-03-18 13:59:20 -07:00
Divyansh Singh	d17b2c74db	feat: add optional check for existence of source directories	2023-03-18 04:35:55 +05:30
Soumik Dutta	fb9677230b	add test to ensure integers are converted to string ... before setting them up to be environment variable values Signed-off-by: Soumik Dutta <shalearkane@gmail.com>	2023-03-18 02:57:56 +05:30
Soumik Dutta	0db137efdf	add option to set borg_files_cache_ttl in config ... Signed-off-by: Soumik Dutta <shalearkane@gmail.com>	2023-03-18 01:48:24 +05:30
Dan Helfman	b343363bb8	Change the default action order to: "create", "prune", "compact", "check" (#304).	2023-03-08 14:05:06 -08:00
Dan Helfman	d88bcc8be9	Add Healthchecks "log" state feature to NEWS.	2023-03-07 15:45:23 -08:00
Dan Helfman	332f7c4bb6	Add support for healthchecks "log" feature (#628). ... Reviewed-on: #645	2023-03-07 22:21:30 +00:00
Dan Helfman	5d19d86e4a	Add flake8-quotes to complain about incorrect quoting so I don't have to!	2023-03-07 14:08:35 -08:00
Soumik Dutta	1573d68fe2	update schema.yaml description ... also add monitor.State.LOG to cronitor. Signed-off-by: Soumik Dutta <shalearkane@gmail.com>	2023-03-05 21:57:13 +05:30
Soumik Dutta	69f6695253	Add support for healthchecks "log" feature #628 ... Signed-off-by: Soumik Dutta <shalearkane@gmail.com>	2023-03-05 19:27:32 +05:30
Dan Helfman	9ec220c600	Add SQLite database dump/restore hook (#295). ... feat: add dump-restore support for sqlite databases	2023-03-04 09:47:21 -08:00
Divyansh Singh	903507bd03	code review	2023-03-04 01:27:07 +05:30
Divyansh Singh	af1cc27988	feat: add dump-restore support for sqlite databases	2023-03-02 23:55:16 +05:30
Dan Helfman	dbf8301c19	Add "checkpoint_volume" configuration option to creates checkpoints every specified number of bytes.	2023-02-27 10:47:17 -08:00
Tom Hubrecht	d80e716822	Add authentication to the ntfy hook	2023-02-24 17:35:53 +01:00
Dan Helfman	418ebc8843	Add MySQL database hook "add_drop_database" configuration option to control whether dumped MySQL databases get dropped right before restore (#642).	2023-02-20 15:32:47 -08:00
Dan Helfman	30cca62d09	Add configuration options for database command customization (#630).	2023-01-26 14:59:17 -08:00
Dan Helfman	0e6b2c6773	Optionally dump "all" PostgreSQL databases to separate files instead of one combined dump file (#438, #560).	2023-01-25 23:31:07 -08:00
Dan Helfman	5e15c9f2bc	Fix traceback when include merging on ARM64 (#622).	2022-12-23 10:07:53 -08:00
Dan Helfman	f67c544be6	Optionally dump "all" PostgreSQL databases to separate files instead of one combined dump file (#438, #560).	2022-12-15 22:59:42 -08:00
Javier Paniagua	faf682ca35	specify pg dump/restore commands (#311)	2022-11-06 11:12:53 +01:00
Dan Helfman	89500df429	Fix traceback when a configuration section is present but lacking any options (#604).	2022-10-23 13:56:03 -07:00
Dan Helfman	ae036aebd7	When the "read_special" option is true or database hooks are enabled, auto-exclude special files for a "create" action to prevent Borg from hanging (#587).	2022-10-03 12:58:13 -07:00
Dan Helfman	c46f2b8508	Fix conflict between "patterns" and "source_directories" (#574), make "source_directories" optional (#542).	2022-08-25 11:55:34 -07:00
Dan Helfman	ef7e95e22a	Fix end-to-end tests.	2022-08-21 23:29:13 -07:00
Dan Helfman	3be99de5b1	Update "repositories" examples in configuration to use ssh:// style syntax.	2022-08-21 22:40:31 -07:00
Dan Helfman	317dc7fbce	Add "before_actions" and "after_actions" command hooks that run before/after all the actions for each repository, update docs to cover per-repository configurations (#463).	2022-08-21 21:48:37 -07:00
Dan Helfman	89d201c8ff	Fleshing out NEWS for the Borg 2 changes.	2022-08-17 21:54:00 -07:00
Dan Helfman	f47c98c4a5	Rename several configuration options to match Borg 2 (#557).	2022-08-17 21:14:58 -07:00
Dan Helfman	28d847b8b1	Warn and tranform on non-ssh://-style repositories (#557).	2022-08-17 10:13:11 -07:00
Dan Helfman	9aece3936a	Modify "mount" and "extract" actions to require the "--repository" flag when multiple repositories are configured (#566).	2022-07-25 11:30:02 -07:00
Dan Helfman	c7e4e6f6c9	Add Healthchecks "verify_tls" option to NEWS.	2022-07-23 23:16:06 -07:00
Uli	5c6407047f	feat: add verify_tls flag for Healthchecks	2022-07-24 07:37:00 +02:00
Dan Helfman	c0f48e1071	Fix command-line "--override" flag to continue supporting old configuration file formats (#561).	2022-07-06 18:14:44 -07:00
Dan Helfman	d372a86fe6	Code formatting.	2022-06-23 10:41:04 -07:00
Sébastien MB	b63c854509	Fix escaped environment variable in configuration ... - when an env variable is escaped in the configuration file, we expect not to resolve it and remove the escape char `\`	2022-06-17 09:50:56 +02:00
Dan Helfman	6d76e8e5cb	Code formatting.	2022-06-16 14:21:18 -07:00
Dan Helfman	aecb6fcd74	Code style, rename command-line flag, and move new code into its own file (#546)	2022-06-16 11:35:24 -07:00
Sébastien MB	97b5cd089d	Allow environment variable resolution in configuration file ... - all string fields containing an environment variable like ${FOO} will be resolved - supported format ${FOO}, ${FOO:-bar} and ${FOO-bar} to allow default values if variable is not present in environment - add --no-env argument for CLI to disable the feature which is enabled by default Resolves: #546	2022-06-16 18:52:54 +02:00
Dan Helfman	f2c2f3139e	Add periods to ntfy config descriptions.	2022-06-10 09:42:41 -07:00
Gavin Chappell	a8b8d507b6	add a hook for sending push notifications via ntfy.sh	2022-06-09 21:10:38 +01:00
Dan Helfman	2bc91ac3d2	Add "generate-borgmatic-config --overwrite" flag to replace an existing destination file (#539).	2022-05-29 16:03:55 -07:00
Dan Helfman	e76bfa555f	Reduce the default consistency check frequency and support configuring the frequency independently for each check (#523).	2022-05-28 14:42:19 -07:00
Dan Helfman	be59a3e574	Fix generate-borgmatic-config with "--source" flag to support more complex schema changes like the new Healthchecks configuration options (#536).	2022-05-25 10:26:26 -07:00
polyzen	8708ca07f4	Remove trailing whitespace	2022-05-25 00:43:40 +00:00
Dan Helfman	157e59ac88	Add Healthchecks monitoring hook "send_logs" option to enable/disable sending borgmatic logs to the Healthchecks server (#460).	2022-05-24 14:44:33 -07:00
Dan Helfman	666f0dd751	Add missing Healthchecks "states" option example in configuration schema (#525).	2022-05-24 14:17:19 -07:00
Dan Helfman	8b179e4647	Reverse logic of Healtchecks "skip_states" option to just "states" (#525).	2022-05-24 14:09:42 -07:00
Dan Helfman	865eff7d98	Add Healthchecks monitoring hook "skip_states" option to disable pinging for particular monitoring states (#525).	2022-05-24 13:59:28 -07:00
Dan Helfman	b9741f4d0b	Add Healthchecks monitoring hook "ping_body_limit" option to configure how many bytes of logs to send to the Healthchecks server (#294).	2022-05-24 12:23:38 -07:00
Dan Helfman	02781662f8	Change monitoring hooks to specify the ping URL / integration key as a named option.	2022-05-23 20:02:10 -07:00
Dan Helfman	32a1043468	Remove the error when "archive_name_format" is specified but a retention prefix isn't (#402).	2022-05-23 16:11:24 -07:00
Dan Helfman	255cc6ec23	When deep merging common configuration, merge colliding list values by appending them (#531).	2022-05-20 15:28:28 -07:00
Dan Helfman	51fc37d57a	Improve the error message when a configuration override contains an invalid value (#528).	2022-05-20 13:38:53 -07:00
Dan Helfman	788281cfb9	When a configuration include is a relative path, load it from either the current working directory or from the directory containing the file doing the including (#532).	2022-05-19 17:15:05 -07:00
Dan Helfman	525266ede6	Deep merging when including common configuration (#381).	2022-04-25 21:18:37 -07:00
Dan Helfman	cbce6707f4	Clarify one_file_system behavior in schema comment (#520).	2022-04-12 11:05:22 -07:00
Dan Helfman	0eb2634f9b	Working directory option to support source directories with relative paths (#431). ... Reviewed-on: #477	2022-03-03 19:28:17 +00:00
Dan Helfman	6bf6ac310b	When using the "bsd_flags" option, tailor the flags passed to Borg depending on the Borg version (#394).	2022-02-09 21:11:00 -08:00
Dan Helfman	4b5af2770d	When the "atime" option is used, tailor the flags passed to Borg depending on version (#394).	2022-02-09 16:54:35 -08:00
Dan Helfman	b525e70e1c	Run "compact" action by default when no actions are specified (#394).	2022-02-09 14:33:12 -08:00
Dan Helfman	4498671233	Remove references to removed long-deprecated options (#394).	2022-02-09 11:08:02 -08:00
Dan Helfman	48f44d2f3d	Add tests for compact action (#394).	2022-02-08 12:05:02 -08:00
Dan Helfman	9582324c88	Compact repository segments with new "borgmatic compact" action (#394).	2022-02-07 23:29:44 -08:00
Dan Helfman	bec73245e9	Fix traceback when a YAML validation error occurs (#480, #482).	2022-01-19 20:39:03 -08:00
fabianschilling	b39f08694d	Merge branch 'master' into pr-working-directory	2022-01-05 09:30:27 +00:00
Dan Helfman	2ee75546f5	Add MongoDB database hook documentation.	2022-01-04 16:26:38 -08:00
Andrea Ghensi	7c6ce9399c	fix integration tests and mongodb auth	2021-12-29 22:18:50 +01:00
Andrea Ghensi	6b7653484b	Add mongodb dump hook	2021-12-26 01:00:58 +01:00
Fabian Schilling	5821c6782e	Add defaults to not set in schema	2021-12-10 18:23:08 +01:00
Fabian Schilling	f15498f6d9	Add working_directory to borgmatic schema	2021-12-10 17:58:27 +01:00
Dan Helfman	2e99a1898c	Fix f-string with missing expression.	2021-11-29 14:05:36 -08:00
Dan Helfman	0e8e9ced64	When command-line configuration override produces a parse error, error cleanly (#471).	2021-11-29 12:49:21 -08:00
Dan Helfman	c646edf2c7	Bump version for release.	2021-11-22 13:19:15 -08:00
nebulon42	3729ba5ca3	add list_options setting, fixes #306	2021-11-20 15:43:58 +01:00
Dan Helfman	38ebfd2969	Rename retry_timeout to retry_wait and standardize log formatting (#28).	2021-11-15 11:51:17 -08:00
cadamswaite	976a877a25	Formatting	2021-11-14 22:37:42 +00:00
cadamswaite	b4117916b8	Add timeout and tests	2021-11-14 22:15:22 +00:00
cadamswaite	6b182c9d2d	Merge branch 'master' into master	2021-11-14 18:24:17 +00:00
Kim B. Heino	717cfd2d37	validate: add support for both jsonschema v3 and old v2 ... RHEL8 and RHEL7 have old jsonschema v2. Try v3 (Draft7) first but fallback to v2 (Draft4) if needed.	2021-10-23 15:04:07 +03:00
Dan Helfman	fbbb096cec	Note in documentation that borgmatic requires Python 3.6+.	2021-10-04 11:15:51 -07:00
Dan Helfman	77980511c6	Add another glob pattern example to exclude patterns.	2021-09-16 09:51:40 -07:00
Dan Helfman	b3f5a9d18f	Fix error when configuration file contains "umask" option (#437).	2021-07-27 10:04:22 -07:00
cadamswaite	510449ce65	Change default retries to 0	2021-07-14 22:49:03 +01:00
cadamswaite	4cc4b8d484	Add queue based retry logic	2021-07-14 22:46:02 +01:00
Dan Helfman	27d37b606b	Better error messages! Switch the library used for validating configuration files (from pykwalify to jsonschema).	2021-06-22 13:27:59 -07:00
Dan Helfman	9016f4be43	Clarify that spaces in path names should not be backslashed in path names (#406).	2021-04-18 17:28:11 -07:00
Dan Helfman	eb4b4cc92b	Fix line length in schema.	2020-11-25 19:21:06 -08:00
Dan Helfman	41bf520585	Document that passphrase is used for Borg keyfile encryption, not just repokey encryption (#373).	2020-11-25 18:36:23 -08:00
Dan Helfman	9b819f32f8	Fix traceback when upgrading old INI-style configuration with upgrade-borgmatic-config (#367).	2020-11-18 15:01:10 -08:00
Dan Helfman	b619bde037	Fix broken end-to-end test.	2020-11-18 14:20:07 -08:00
François Poulain	ebac02f118	Mention placeholders for repositories in documentation; fix #369	2020-11-18 20:22:41 +01:00
root	7cad5a8608	Add `temporary_directory` as a configuration option defaulting to $TMPDIR	2020-08-26 15:29:02 +00:00
Matthias	631c3068a9	systemd security settings	2020-08-22 15:41:25 +02:00
networkjanitor	3c723e8d99	Merge branch 'master' into master	2020-08-12 21:11:45 +00:00
Dan Helfman	5356f487a5	Move before/after_everything hooks so they're easier to find.	2020-08-12 13:46:31 -07:00
Dan Helfman	72bd96c656	Fix traceback when a configuration directory is non-readable due to directory permissions (#350).	2020-08-12 11:32:00 -07:00
Jakub Duchateau	95c415f416	Change "before" to "after" in desc	2020-08-07 16:41:35 +02:00
Dan Helfman	06dc336481	Fix schema exclude patterns example path.	2020-08-06 09:59:48 -07:00
networkjanitor	893fca2816	Add before_extract and after_extract hooks	2020-08-01 16:08:32 +02:00
Dan Helfman	a23083f737	Clarify schema documentation about skipping pruning.	2020-07-22 10:35:16 -07:00
Edward Shornock	01db676d68	Change the example for the ssl_mode parameter	2020-06-20 23:32:24 +03:00
Edward Shornock	8fb830099f	Re-add the ilbpq-ssl documentation URL to the schema ... It's been moved from describing `ssl_mode` to the general postgresql_database description key.	2020-06-19 13:22:39 +03:00
Edward Shornock	463a133a63	Ensure schema lines are less than 80 characters in length	2020-06-19 13:22:39 +03:00
Edward Shornock	a16fed8887	Rename PostgreSQL SSL config variables ... e.g. s/sslmode/ssl_mode/g to conform with borgmatic naming conventions.	2020-06-19 13:20:14 +03:00
Edward Shornock	abd47fc14e	Add SSL support to PostgreSQL hooks	2020-06-19 02:19:17 +03:00
Dan Helfman	7fb4061759	Improve configuration reference documentation readability via more aggressive word-wrapping in configuration schema descriptions.	2020-06-17 23:15:12 -07:00
Dan Helfman	00033bf0a8	Tweak comment indentation in generated configuration file for clarity.	2020-06-02 11:37:13 -07:00
Dan Helfman	097a09578a	Fix enabled database hooks to implicitly set one_file_system configuration option to true to prevent Borg hang. (#315).	2020-05-26 09:20:14 -07:00
Dan Helfman	bc02c123e6	Monitor backups with PagerDuty hook integration (#245).	2020-01-27 15:32:09 -08:00
Dan Helfman	8ad8a9c422	Add per-action hooks: "before_prune", "after_prune", "before_check", and "after_check" (#255).	2020-01-27 11:07:07 -08:00
Dan Helfman	2405e97c38	Backup to a removable drive or intermittent server via "soft failure" feature (#284).	2020-01-24 20:52:48 -08:00
Dan Helfman	94b9ef56be	Change "exclude_if_present" option to support multiple filenames, rather than just a single filename (#280).	2020-01-23 13:41:37 -08:00
Dan Helfman	39550a7fe9	Add ~/.config/borgmatic.d as another configuration directory default (#274).	2020-01-22 09:26:58 -08:00
Dan Helfman	d0c533555e	In "borgmatic --help", don't expand $HOME in listing of default "--config" paths.	2020-01-02 10:37:31 -08:00
Dan Helfman	f787dfe809	Override particular configuration options from the command-line via "--override" flag (#268).	2019-12-17 11:46:27 -08:00
Dan Helfman	8660af745e	Optionally change the internal database dump path via "borgmatic_source_directory" option in location configuration section (#259).	2019-12-10 16:04:34 -08:00
Dan Helfman	65cc4c9429	Fix "--repository" flag to accept relative paths.	2019-12-06 16:29:41 -08:00
Dan Helfman	0c6c61a272	Pass extra options directly to particular Borg commands, handy for Borg options that borgmatic does not yet support natively (#235).	2019-12-04 15:48:10 -08:00
Dan Helfman	427b57e2a9	Database dump hooks for MySQL/MariaDB (#228).	2019-11-08 11:17:52 -08:00
Dan Helfman	17fda7281a	Monitor backups with Cronhub hook integration. Fix Healthchecks/Cronitor hooks to respect dry run.	2019-11-07 10:08:44 -08:00
Dan Helfman	ac777965d0	Fix regression of generate-borgmatic-config working without --source flag (#239).	2019-11-06 09:52:21 -08:00
Dan Helfman	31d3bc9bd8	In documentation, clarify when Healthchecks/Cronitor hooks fire in relation to other hooks (#238).	2019-11-06 09:44:46 -08:00
Dan Helfman	2115eeb6a2	Upgrade your borgmatic configuration to get new options and comments via "generate-borgmatic-config --source" (#239).	2019-11-06 09:31:00 -08:00
Dan Helfman	f48f52079d	Support for Borg --keep-exclude-tags and --exclude-nodump options (#234).	2019-11-01 15:50:59 -07:00
Dan Helfman	8fd46b8c70	Monitor backups with Cronitor hook integration.	2019-11-01 11:33:15 -07:00
Dan Helfman	458e7776c5	Database dump hooks for PostgreSQL, so you can easily dump your databases before backups run (#225).	2019-10-22 16:28:42 -07:00
Dan Helfman	f8bc67be8d	Config generation support for sequences of maps, needed for database dump hooks (#225).	2019-10-21 15:17:47 -07:00
Dan Helfman	128ebf04ce	Dead man's switch via healthchecks.io integration (#223) + new monitoring documentation.	2019-10-15 10:49:14 -07:00
Dan Helfman	e14ebee4e0	User-defined hooks for global setup or cleanup that run before/after all actions. (#192).	2019-09-28 16:18:10 -07:00
Dan Helfman	4cdff74e9b	Support for Borg check --verify-data flag via borgmatic "data" consistency check (#210).	2019-09-18 16:52:27 -07:00
Daniel M. Capella	0c439c0c02	Add space to separate comments from tokens ... https://yaml.org/spec/1.2/spec.html#id2780069	2019-09-17 20:00:58 -04:00
Dan Helfman	ef3dda9213	Bypass Borg error about a moved repository (#209).	2019-08-26 09:39:41 -07:00
Dan Helfman	a7cc2ea803	When validating configuration files, require strings instead of allowing any scalar type.	2019-08-03 14:52:12 -07:00
Dan Helfman	39e5aac479	If a "prefix" option in borgmatic's configuration has an empty value (blank or ""), then disable default prefix.	2019-07-27 14:04:13 -07:00
Dan Helfman	e25f2c4e6c	Clarify documentation/schema about on_error hook running if there's an error in another hook (#202).	2019-07-19 09:25:01 -07:00
Dan Helfman	4444219e17	Support for Borg --noatime, --noctime, and --nobirthtime flags (mentioned in #193).	2019-06-25 11:30:55 -07:00
Dan Helfman	74ac148747	Disable console color via "color" option in borgmatic configuration output section (#191).	2019-06-19 20:48:54 -07:00
Dan Helfman	b3aa6af859	Don't color syslog output (#197).	2019-06-17 11:53:08 -07:00
Dan Helfman	6c136ebbf1	Fix for unclear error message for invalid YAML merge include (#196).	2019-06-16 21:33:40 -07:00
Dan Helfman	d6d66de251	Set umask used when executing hooks via "umask" option in borgmatic hooks section (#189).	2019-06-13 17:05:26 -07:00