326 Commits

Author	SHA1	Message	Date
Dan Helfman	f36e38ec20	Update mount action for Borg 2 support (#557).	2022-08-15 19:32:37 -07:00
Dan Helfman	d807ce095e	Update export-tar action for Borg 2 support (#557).	2022-08-15 17:34:12 -07:00
Dan Helfman	7626fe1189	Disallow borg list --json with --archive or --find (#557).	2022-08-15 15:40:28 -07:00
Dan Helfman	cc04bf57df	Update list action for Borg 2 support, add rinfo action, and update extract consistency check for Borg 2.	2022-08-15 15:04:40 -07:00
Dan Helfman	94321aec7a	Update compact action for Borg 2 support (#557).	2022-08-13 22:07:15 -07:00
Dan Helfman	4a55749bd2	Update prune action for Borg 2 support (#557).	2022-08-13 17:26:51 -07:00
Dan Helfman	c7176bd00a	Add rinfo action for Borg 2 support (#557).	2022-08-12 23:06:56 -07:00
Dan Helfman	647ecdac29	Borg 2 support in borgmatic check action (#557).	2022-08-12 15:46:33 -07:00
Dan Helfman	622caa0c21	Support for Borg 2's rcreate and rinfo sub-commands (#557).	2022-08-12 14:53:20 -07:00
Dan Helfman	9aece3936a	Modify "mount" and "extract" actions to require the "--repository" flag when multiple repositories are configured (#566).	2022-07-25 11:30:02 -07:00
Dan Helfman	457ed80744	Fix environment variable plumbing so options in one configuration file aren't used for others (#555).	2022-06-30 13:42:17 -07:00
Dan Helfman	aecb6fcd74	Code style, rename command-line flag, and move new code into its own file (#546)	2022-06-16 11:35:24 -07:00
Sébastien MB	97b5cd089d	Allow environment variable resolution in configuration file ... - all string fields containing an environment variable like ${FOO} will be resolved - supported format ${FOO}, ${FOO:-bar} and ${FOO-bar} to allow default values if variable is not present in environment - add --no-env argument for CLI to disable the feature which is enabled by default Resolves: #546	2022-06-16 18:52:54 +02:00
Dan Helfman	65b2fe86c6	Fix Bash completion script to no longer alter your shell's settings.	2022-06-09 16:29:54 -07:00
Dan Helfman	d14f22e121	Add "borgmatic list --find" flag for searching for files across multiple archives (#541).	2022-06-03 15:12:14 -07:00
Dan Helfman	80ec3e7d97	Deprecate "borgmatic list --successful" flag, as listing only non-checkpoint (successful) archives is now the default in newer versions of Borg.	2022-06-02 20:35:39 -07:00
Dan Helfman	2bc91ac3d2	Add "generate-borgmatic-config --overwrite" flag to replace an existing destination file (#539).	2022-05-29 16:03:55 -07:00
Dan Helfman	c7f5d5fd0b	Fix broken Bash completion of filenames, as in "-c config.yaml".	2022-05-29 10:49:33 -07:00
Dan Helfman	6ef7538eb0	Fix typo in Bash completions script.	2022-05-28 19:34:13 -07:00
Dan Helfman	8fa90053cf	Add "borgmatic check --force" flag to ignore configured check frequencies (#523).	2022-05-28 19:29:33 -07:00
Dan Helfman	6629f40cab	In bash completion script, warn when script is out of date using script contents instead of version. (Fewer spurious warnings that way.)	2022-05-28 15:27:11 -07:00
Dan Helfman	e76bfa555f	Reduce the default consistency check frequency and support configuring the frequency independently for each check (#523).	2022-05-28 14:42:19 -07:00
Dan Helfman	77b84f8a48	Add Bash completion script so you can tab-complete the borgmatic command-line.	2022-05-26 10:27:53 -07:00
Dan Helfman	ed7fe5c6d0	Instead of executing "before" command hooks before all borgmatic actions run (and "after" hooks after), execute these hooks right before/after the corresponding action (#473).	2022-04-21 22:08:25 -07:00
Dan Helfman	9f44bbad65	Fix borgmatic exit code (so it's zero) when initial Borg calls fail but later retries succeed (#517).	2022-04-02 22:28:41 -07:00
Dan Helfman	db7499db82	Document "repositories" context to for "before_*" and "after_*" command action hooks (#469).	2022-03-14 13:34:14 -07:00
Dan Helfman	6b500c2a8b	Add repositories context for command hooks. ... Reviewed-on: #469	2022-03-14 20:13:15 +00:00
Dan Helfman	976516d0e1	When loading a configuration file that is unreadable due to file permissions, warn instead of erroring (#444).	2022-03-08 10:19:36 -08:00
Dan Helfman	948c86f62c	When using the "numeric_owner" option with the "extract" action, tailor the flags passed to Borg depending on the Borg version (#394).	2022-02-10 10:09:18 -08:00
Dan Helfman	4b5af2770d	When the "atime" option is used, tailor the flags passed to Borg depending on version (#394).	2022-02-09 16:54:35 -08:00
Dan Helfman	b525e70e1c	Run "compact" action by default when no actions are specified (#394).	2022-02-09 14:33:12 -08:00
Dan Helfman	9997aa9a92	Fix capitalization on compact help.	2022-02-08 15:58:09 -08:00
Dan Helfman	48f44d2f3d	Add tests for compact action (#394).	2022-02-08 12:05:02 -08:00
Dan Helfman	9582324c88	Compact repository segments with new "borgmatic compact" action (#394).	2022-02-07 23:29:44 -08:00
Chen Yufei	0014b149f8	remove configuration_filename as it's already set.	2021-11-26 11:38:58 +08:00
Chen Yufei	091c07bbe2	Add context for various hooks.	2021-11-26 11:35:10 +08:00
Dan Helfman	38ebfd2969	Rename retry_timeout to retry_wait and standardize log formatting (#28).	2021-11-15 11:51:17 -08:00
cadamswaite	976a877a25	Formatting	2021-11-14 22:37:42 +00:00
cadamswaite	b4117916b8	Add timeout and tests	2021-11-14 22:15:22 +00:00
cadamswaite	89baf757cf	Sort imports	2021-07-14 23:17:35 +01:00
cadamswaite	4f36fe2b9f	Run Black on changed file	2021-07-14 22:53:01 +01:00
cadamswaite	510449ce65	Change default retries to 0	2021-07-14 22:49:03 +01:00
cadamswaite	4cc4b8d484	Add queue based retry logic	2021-07-14 22:46:02 +01:00
Dan Helfman	cf8882f2bc	Run arbitrary Borg commands with new "borgmatic borg" action (#425).	2021-06-17 20:41:44 -07:00
Dan Helfman	9b819f32f8	Fix traceback when upgrading old INI-style configuration with upgrade-borgmatic-config (#367).	2020-11-18 15:01:10 -08:00
Dan Helfman	8aa7830f0d	Fix broken "--override" action in Python 3.7 and below.	2020-11-15 13:39:15 -08:00
Dan Helfman	1ea04aedf0	Merge override values when specifying the "--override" flag multiple times (#361).	2020-10-23 16:06:00 -07:00
Diego Blanco	2d10e758e0	Fixed minor typo in help for "info" command	2020-10-12 00:04:15 +02:00
Dan Helfman	0e978299cf	Fix traceback when a database hook value is null in a configuration file (#355).	2020-10-07 15:41:45 -07:00
networkjanitor	c5776447b9	fixed description strings for before_extract and after_extract	2020-08-12 23:07:57 +02:00
networkjanitor	893fca2816	Add before_extract and after_extract hooks	2020-08-01 16:08:32 +02:00
Dan Helfman	b3fd1be5f6	Add "borgmatic export-tar" action to export an archive to a tar-formatted file or stream (#300).	2020-07-22 21:53:55 -07:00
Dan Helfman	37cc229749	Fix duplicate logging to Healthchecks and send "after_*" hooks output to Healthchecks (#328).	2020-06-23 11:01:03 -07:00
Dan Helfman	aa14449857	Add "borgmatic extract --strip-components" flag to remove leading path components when extracting an archive (#324).	2020-06-06 14:57:14 -07:00
Dan Helfman	398665be9e	Allow before_backup and similiar hooks to exit with a soft failure without altering the monitoring status (#292).	2020-06-02 14:33:41 -07:00
Dan Helfman	89cb5eb76d	Fix regression in support for PostgreSQL's "directory" dump format (#314).	2020-05-18 11:31:29 -07:00
Dan Helfman	1ea047dd94	Remove "borgmatic restore --progress" flag, as it now conflicts with streaming database restores.	2020-05-09 21:53:16 -07:00
Dan Helfman	a23fdf946d	Stream database dumps and restores directly to/from Borg without using any additional filesystem space (#258).	2020-05-07 11:44:04 -07:00
Dan Helfman	d6562c4b1e	Fix the "--stats" and "--files" flags so that they yield output at verbosity 0 (#290).	2020-01-31 10:23:36 -08:00
Dan Helfman	55141bda67	Specify "--archive latest" to all actions that accept an archive (#289).	2020-01-29 16:59:02 -08:00
Dan Helfman	8ad8a9c422	Add per-action hooks: "before_prune", "after_prune", "before_check", and "after_check" (#255).	2020-01-27 11:07:07 -08:00
Dan Helfman	2405e97c38	Backup to a removable drive or intermittent server via "soft failure" feature (#284).	2020-01-24 20:52:48 -08:00
Dan Helfman	fdbb2ee905	View consistency check progress via "--progress" flag for "check" action (#287).	2020-01-24 11:27:16 -08:00
Dan Helfman	952168ce25	Fix unwanted console log messages with "list --json" and "info --json".	2020-01-23 13:40:54 -08:00
Dan Helfman	5273037a94	For "list" and "info" actions, show repository names even at verbosity 0.	2020-01-23 11:17:39 -08:00
Dan Helfman	f66fd1caaa	Customize Healthchecks log level via borgmatic "--monitoring-verbosity" flag (#277).	2020-01-22 15:10:47 -08:00
Dan Helfman	d93fdbc5ad	Support "--files" and "--stats" flags at verbosity level 0.	2020-01-22 13:28:24 -08:00
palto42	e27ba0d08a	less detail at v1 + option "--files" for details	2020-01-11 16:38:07 +01:00
Dan Helfman	5afe0e3d63	Disable colored output when "--json" flag is used, so as to produce valid JSON ouput (#276).	2020-01-04 15:50:41 -08:00
Dan Helfman	d0c533555e	In "borgmatic --help", don't expand $HOME in listing of default "--config" paths.	2020-01-02 10:37:31 -08:00
Dan Helfman	911668f0c8	Only trigger "on_error" hooks and monitoring failures for "prune", "create", and "check" actions, and not for other actions (#270).	2019-12-20 13:58:02 -08:00
Dan Helfman	f787dfe809	Override particular configuration options from the command-line via "--override" flag (#268).	2019-12-17 11:46:27 -08:00
Dan Helfman	e009bfeaa2	Update Healthchecks/Cronitor/Cronhub monitoring integrations to fire for "check" and "prune" actions, not just "create" (#249).	2019-12-12 22:54:45 -08:00
Dan Helfman	8660af745e	Optionally change the internal database dump path via "borgmatic_source_directory" option in location configuration section (#259).	2019-12-10 16:04:34 -08:00
Dan Helfman	826e4352d1	Filter listed paths via "borgmatic list --path" flag (#269).	2019-12-08 14:07:02 -08:00
Dan Helfman	b94999bba4	Fix "borgmatic umount" so it only runs Borg once instead of once per repository / configuration file.	2019-12-07 21:36:51 -08:00
Dan Helfman	65cc4c9429	Fix "--repository" flag to accept relative paths.	2019-12-06 16:29:41 -08:00
Dan Helfman	df2be9620b	Mount whole repositories via "borgmatic mount" without any "--archive" flag (#253).	2019-12-06 15:58:54 -08:00
Dan Helfman	2ab9daaa0f	Attempt to repair any inconsistencies found during a consistency check via "borgmatic check --repair" flag (#266).	2019-12-04 16:07:00 -08:00
Dan Helfman	0c6c61a272	Pass extra options directly to particular Borg commands, handy for Borg options that borgmatic does not yet support natively (#235).	2019-12-04 15:48:10 -08:00
Dan Helfman	375036e409	Support for mounting an archive as a FUSE filesystem via "borgmatic mount" action, and unmounting via "borgmatic umount" (#123).	2019-11-25 14:56:20 -08:00
Dan Helfman	f4a231420f	Show summary log errors regardless of verbosity. Log the "summary:" header with level based on the contained logs.	2019-11-25 10:31:09 -08:00
Dan Helfman	55ebfdda39	Show full error logs at "--verbosity 0" so you can see command output without upping the verbosity level.	2019-11-19 10:09:25 -08:00
Dan Helfman	e63e2e0852	Rephrasing verbosity levels.	2019-11-17 22:52:26 -08:00
Dan Helfman	edc4b9e60e	Update the command-line help description.	2019-11-17 22:49:16 -08:00
Dan Helfman	2cc743cf47	With "borgmatic check", consider Borg warnings as errors (#247).	2019-11-17 19:06:28 -08:00
Dan Helfman	50f62d73b7	When using the Healthchecks monitoring hook, include borgmatic logs in the payloads for completion and failure pings (#241).	2019-11-17 16:54:27 -08:00
Dan Helfman	6cdc92bd0c	Fix for "borgmatic restore" showing success and incorrectly extracting archive files, even when no databases are configured to restore (#246).	2019-11-13 10:41:57 -08:00
Dan Helfman	781fac3266	Refactor ping monitors (Healthchecks, Cronitor, Cronhub) to share a common invocation and function signature.	2019-11-12 15:31:07 -08:00
Dan Helfman	30525c43bf	Another edge case: Don't error on non-matching restore path globs (#228).	2019-11-12 11:24:31 -08:00
Dan Helfman	a3e939f34b	Factor out filtering of database configuration to function with tests (#228).	2019-11-12 10:39:36 -08:00
Dan Helfman	ded042d8cc	First crack at MySQL/MariaDB database restore (#228).	2019-11-11 21:59:30 -08:00
Dan Helfman	9d29ecf304	Remove MySQL/MariaDB database dumps after backing them up (#228).	2019-11-08 11:53:27 -08:00
Dan Helfman	427b57e2a9	Database dump hooks for MySQL/MariaDB (#228).	2019-11-08 11:17:52 -08:00
Dan Helfman	17fda7281a	Monitor backups with Cronhub hook integration. Fix Healthchecks/Cronitor hooks to respect dry run.	2019-11-07 10:08:44 -08:00
Dan Helfman	2115eeb6a2	Upgrade your borgmatic configuration to get new options and comments via "generate-borgmatic-config --source" (#239).	2019-11-06 09:31:00 -08:00
palto42	18d3542fbc	new verbosity level "-1" for errors	2019-11-03 09:55:19 +01:00
Dan Helfman	a9104ed090	Handle log file error more consistently with other error. Add --log-file-verbosity flag. Add docs.	2019-11-02 11:23:18 -07:00
palto42	b121290c0f	Merge remote-tracking branch 'upstream/master' into logging	2019-11-01 19:44:04 +01:00
Dan Helfman	8fd46b8c70	Monitor backups with Cronitor hook integration.	2019-11-01 11:33:15 -07:00
Dan Helfman	603f525352	Clarify --archive help.	2019-11-01 10:50:20 -07:00
Dan Helfman	e3dd545345	Extract files to a particular directory via "borgmatic extract --destination" flag. Also rename "--restore-path" to "--path" to reduce confusion.	2019-11-01 10:00:26 -07:00
Dan Helfman	3006db0cae	Restore backed up PostgreSQL databases via "borgmatic restore" sub-command (#229).	2019-10-31 12:57:36 -07:00
palto42	22640a9ca0	new option for log-file	2019-10-31 10:44:22 +01:00
Dan Helfman	4dc4fe0b8d	Reordering hooks a bit so that pre-backup ordering mirrors post-backup ordering.	2019-10-27 14:47:55 -07:00
Dan Helfman	fc274b43f0	Rename "borgmatic list --pattern-from" flag to "--patterns-from" to match Borg (#230).	2019-10-22 22:42:36 -07:00
Dan Helfman	458e7776c5	Database dump hooks for PostgreSQL, so you can easily dump your databases before backups run (#225).	2019-10-22 16:28:42 -07:00
Dan Helfman	fa5fa1c11b	Move hooks into directory, so there can be one source file per type of hook (#225).	2019-10-21 15:52:14 -07:00
Dan Helfman	128ebf04ce	Dead man's switch via healthchecks.io integration (#223) + new monitoring documentation.	2019-10-15 10:49:14 -07:00
Dan Helfman	7b3b28616d	Add "borgmatic list --successful" flag to only list successful (non-checkpoint) archives (#86).	2019-10-13 15:58:11 -07:00
Dan Helfman	f3910f49ca	Fix incorrect help on borg list --last flag.	2019-10-13 14:46:28 -07:00
Dan Helfman	1d37b14356	More detailed error alerting via runtime context available in "on_error" hook (#174).	2019-10-01 12:23:16 -07:00
Dan Helfman	6c617eddd5	When backups to one of several repositories fails, keep backing up to the other repositories (#144).	2019-09-30 22:19:31 -07:00
Dan Helfman	e14ebee4e0	User-defined hooks for global setup or cleanup that run before/after all actions. (#192).	2019-09-28 16:18:10 -07:00
Dan Helfman	340bd72176	Fix regression of argument parsing for default actions (#220).	2019-09-22 11:30:58 -07:00
Dan Helfman	1a1bb71af1	Fix error with "borgmatic check --only" command-line flag with "extract" consistency check (#217).	2019-09-20 11:43:27 -07:00
Dan Helfman	ae45dfe63a	Clarify command-like help for check --only.	2019-09-19 15:20:05 -07:00
Dan Helfman	81739791e0	Override configured consistency checks via "borgmatic check --only" command-line flag (#210).	2019-09-19 11:43:53 -07:00
Dan Helfman	90595e9c18	Only log to syslog when run from a non-interactive console (e.g. a cron job). Related to #197.	2019-06-27 14:41:21 -07:00
Dan Helfman	86dbc00cbe	Support for several more borgmatic/borg info command-line flags (#193).	2019-06-25 10:46:55 -07:00
Dan Helfman	c644270599	Pass through several "borg list" flags (#193).	2019-06-25 10:18:30 -07:00
Dan Helfman	1676a98c51	Fix for Borg create error output not showing up at borgmatic verbosity level zero (#198).	2019-06-24 09:55:41 -07:00
Dan Helfman	c15e6c5fe5	More actions help.	2019-06-23 09:46:22 -07:00
Dan Helfman	4bf3e906a1	Break out main borgmatic arguments-parsing code into a separate file.	2019-06-22 21:32:27 -07:00
Dan Helfman	0ca43ef67a	Get tests passing.	2019-06-22 21:23:48 -07:00
Dan Helfman	75c04611dc	Refactor to support subparsed-based parsed arguments.	2019-06-22 16:10:07 -07:00
Dan Helfman	881dc9b01e	Make each subparser get a crack all all arguments.	2019-06-21 23:12:37 -07:00
Dan Helfman	8c72e909a7	Initial stab at subparsers for argument parsing. Not yet fully working.	2019-06-21 22:27:16 -07:00
Dan Helfman	74ac148747	Disable console color via "color" option in borgmatic configuration output section (#191).	2019-06-19 20:48:54 -07:00
Dan Helfman	be7887c071	Demote log level of unhelpful info log (#194).	2019-06-19 12:01:03 -07:00
Dan Helfman	b3aa6af859	Don't color syslog output (#197).	2019-06-17 11:53:08 -07:00
Dan Helfman	de94001508	Change default syslog verbosity to show errors only.	2019-06-16 21:57:14 -07:00
Dan Helfman	d6d66de251	Set umask used when executing hooks via "umask" option in borgmatic hooks section (#189).	2019-06-13 17:05:26 -07:00
Dan Helfman	7f126ce127	Move hook.py file up a level.	2019-06-13 10:09:16 -07:00
Dan Helfman	a74ad5475e	Run all Borg commands such that they log to syslog as well as console.	2019-06-12 20:56:20 -07:00
Dan Helfman	fa293828df	Run hooks such that their output goes to syslog as well as console.	2019-06-12 13:09:04 -07:00
Dan Helfman	9a5e7a3abb	Successfully convert Borg output to Python logging entries.	2019-06-11 16:42:04 -07:00
Dan Helfman	12441331e6	Fix formatting / import ordering.	2019-05-27 15:46:38 -07:00
Dan Helfman	9ceeae2de0	Add separate syslog verbosity flag.	2019-05-27 15:44:48 -07:00
Dan Helfman	e0e493c2f1	Factor out configuring of logging into a common function.	2019-05-27 15:05:26 -07:00
Dan Helfman	0f05f7ad93	Log to syslog in addition to existing standard out logging (#53).	2019-05-26 16:34:46 -07:00
Luke Murphy	1c0dc3f904	Run isort over the source	2019-05-14 18:59:19 +02:00
Luke Murphy	1f524d6c87	Add borgmatic custom logger	2019-05-13 13:40:18 +02:00
Dan Helfman	8650a15db1	Document validate-borgmatic-config and add a few tests.	2019-05-11 14:05:16 -07:00
Robin Schneider	52e4f48eb9	Add validate-borgmatic-config command ... Useful when generating the borgmatic configuration file with configuration management and before moving the generated file in place checking if it is actually valid.	2019-05-10 00:10:28 +02:00
Dan Helfman	a291477c19	Fix for hooks executing when using --dry-run (#160).	2019-05-07 16:06:31 -07:00
Dan Helfman	1c88dda76a	Fix for invalid JSON output when using multiple borgmatic configuration files (#155).	2019-04-02 22:30:14 -07:00
Dan Helfman	3cb52423d2	Support for Borg create/extract --numeric-owner flag (#147).	2019-03-05 09:11:35 -08:00
Dan Helfman	4272c6b077	List the files within an archive via --list --archive option (#140).	2019-02-23 23:02:17 -08:00
Dan Helfman	5ea2d644a2	Fix error handling when --extract repository guard fails.	2019-02-18 21:52:56 -08:00