Commit Graph

716 Commits

Author SHA1 Message Date
ec9def4e71 rename repository arg to repository_path in all borg actions 2023-03-26 23:52:25 +05:30
b511e679ae remove optional label for repos from tests 2023-03-26 16:59:29 +05:30
ff1f4dc09c minor fixes to prune argument help text 2023-03-26 02:06:46 +05:30
141474ff07 Added TIMESPAN flags to match archive in various commands (Borg2 feature)
Signed-off-by: jetchirag <thechiragaggarwal@gmail.com>
2023-03-26 01:58:03 +05:30
19e95628c3 Add documentation and NEWS for custom constants feature (#612).
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-24 23:47:05 -07:00
4d01e53414
Fix: replace primitive values in config without quotes (#612).
Merge pull request #62 from diivi/fix/config-json-replacement
2023-03-24 23:45:36 -07:00
a082cb87cb fix: replace primitive values in config without quotes 2023-03-25 12:12:56 +05:30
1c51a8e229
Allow defining custom variables in config file (#612).
Merge pull request #60 from diivi/feat/constants-support
2023-03-24 22:50:57 -07:00
af3431d6ae
fix: docs cli reference create spelling
All checks were successful
continuous-integration/drone/push Build is passing
Merge pull request #61 from diivi/docs/cli-reference
2023-03-24 16:09:50 -07:00
61ce6f0473 fix: docs cli reference create spelling 2023-03-25 02:44:56 +05:30
78e8bb6c8c reformat 2023-03-25 02:08:52 +05:30
af95134cd2 add test for complex constant 2023-03-25 02:03:36 +05:30
d6dfb8753a reformat 2023-03-25 01:50:47 +05:30
1bc003560a Merge branch 'master' of https://github.com/diivi/borgmatic into feat/tag-repos 2023-03-25 01:39:26 +05:30
aeaf69f49e pass all tests 2023-03-25 01:34:03 +05:30
e83ad9e1e4 use repository["path"] instead of repository 2023-03-25 01:04:57 +05:30
f42890430c Add code style plugins to enforce use of Python f-strings and prevent single-letter variables.
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-23 23:11:14 -07:00
6f300b0079 feat: constants support 2023-03-24 02:39:37 +05:30
0a72c67c6c Add missing source directory error fix to NEWS (#655).
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-22 13:02:22 -07:00
ab64b7ef67
Fix error when a source directory doesn't exist and databases are configured (#655).
Merge pull request #56 from diivi/fix/no-error-on-database-backup-without-source-dirs
2023-03-22 12:59:01 -07:00
1e3a3bf1e7 review 2023-03-23 01:18:06 +05:30
7a2f287918 reformat base 2023-03-23 01:08:30 +05:30
8a63c49498 feat: tag repos 2023-03-23 01:01:26 +05:30
3b5ede8044 remove extra parameter from function call 2023-03-22 23:11:44 +05:30
bd235f0426 use exit_code_indicates_error and modify it to accept a command 2023-03-22 16:23:53 +05:30
09183464cd fix: no error on database backups without source dirs 2023-03-22 09:41:39 +05:30
dd9a64f4b6
Fix confusing message when an error occurs running actions for a configuration file (#623).
Merge pull request #55 from diivi/fix/rephrase-error-message
2023-03-21 14:23:09 -07:00
23e7f27ee4 fix: rephrase error when running from config
to avoid confusion, as the user might think the problem is with their config file
2023-03-22 02:22:43 +05:30
f9ef52f9a5 Remove unused module and outdated test expectations (#576).
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-21 10:29:17 -07:00
39ad8f64c4 add tests and remove magic number 2023-03-21 17:06:03 +05:30
e86d223bbf Merge branch 'master' of https://github.com/diivi/borgmatic into feat/file-urls-support 2023-03-21 16:55:05 +05:30
86587ab2dc send repo directly to extract and export_tar 2023-03-20 21:51:45 +05:30
58c95d8015 feat: file:// URLs support 2023-03-20 02:43:23 +05:30
b115fb2fbe Merge branch 'master' of github.com:borgmatic-collective/borgmatic 2023-03-18 14:01:52 -07:00
31d04d9ee3
Optionally error if a source directory does not exist.
feat: add optional check for existence of source directories
2023-03-18 13:59:20 -07:00
f803836416 reformat 2023-03-18 17:27:33 +05:30
997f60b3e6 add tests 2023-03-18 17:24:21 +05:30
d17b2c74db feat: add optional check for existence of source directories 2023-03-18 04:35:55 +05:30
fb9677230b add test to ensure integers are converted to string
before setting them up to be environment variable values

Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-03-18 02:57:56 +05:30
0db137efdf add option to set borg_files_cache_ttl in config
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-03-18 01:48:24 +05:30
Nain
5f87ea3ec5 Add "--repository" flag to the "create" action 2023-03-16 13:15:49 -04:00
Nain
a8aeace5b5 Add "--repository" flag to the "compact" action 2023-03-16 11:13:45 -04:00
Nain
480addd7ce Add "--repository" flag to the "check" action 2023-03-16 10:41:13 -04:00
Nain
cdbe6cdf3a Add "--repository" flag to the "prune" action
part of ticket #564
2023-03-15 14:43:17 -04:00
8cec7c74d8 Add "--strip-components all" on the "extract" action to remove leading path components (#647).
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-09 10:09:16 -08:00
b343363bb8 Change the default action order to: "create", "prune", "compact", "check" (#304).
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-08 14:05:06 -08:00
9db31bd1e9 Run any command-line actions in the order specified instead of using a fixed ordering (#304).
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-08 13:19:41 -08:00
d88bcc8be9 Add Healthchecks "log" state feature to NEWS.
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-07 15:45:23 -08:00
332f7c4bb6 Add support for healthchecks "log" feature (#628).
Some checks failed
continuous-integration/drone/push Build is failing
Reviewed-on: #645
2023-03-07 22:21:30 +00:00
5d19d86e4a Add flake8-quotes to complain about incorrect quoting so I don't have to!
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-07 14:08:35 -08:00
044ae7869a fix tests
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-03-08 03:30:12 +05:30
4fcfddbe08 return early if unsupported state is passed
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-03-06 19:58:57 +05:30
45256ae33f add test for healthchecks
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-03-06 03:38:08 +05:30
1573d68fe2 update schema.yaml description
also add monitor.State.LOG to cronitor.

Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-03-05 21:57:13 +05:30
69f6695253 Add support for healthchecks "log" feature #628
Signed-off-by: Soumik Dutta <shalearkane@gmail.com>
2023-03-05 19:27:32 +05:30
e1f02d9fa5 Add SQLite feature to NEWS and also integrations.
All checks were successful
continuous-integration/drone/push Build is passing
2023-03-04 09:59:16 -08:00
9ec220c600
Add SQLite database dump/restore hook (#295).
feat: add dump-restore support for sqlite databases
2023-03-04 09:47:21 -08:00
cf0275a3ed remove test path 2023-03-04 23:00:57 +05:30
c71eb60cd2 mock os.remove instead of actually removing a file 2023-03-04 13:08:30 +05:30
675e54ba9f use os.remove and improve tests 2023-03-04 12:43:07 +05:30
903507bd03 code review 2023-03-04 01:27:07 +05:30
a071e02d20 With the "create" action and the "--list" ("--files") flag, only show excluded files at verbosity 2 (#620).
Some checks failed
continuous-integration/drone/push Build is failing
2023-03-02 15:33:42 -08:00
af1cc27988 feat: add dump-restore support for sqlite databases 2023-03-02 23:55:16 +05:30
dbf8301c19 Add "checkpoint_volume" configuration option to creates checkpoints every specified number of bytes.
All checks were successful
continuous-integration/drone/push Build is passing
2023-02-27 10:47:17 -08:00
2a36a2a312 Add "--repository" flag to the "rcreate" action. Add "--progress" flag to the "transfer" action.
Some checks failed
continuous-integration/drone/push Build is failing
2023-02-26 23:22:23 -08:00
d7a07f0428 Support status character changes in Borg 2.0.0b5 when filtering out special files that cause Borg to hang.
All checks were successful
continuous-integration/drone/push Build is passing
2023-02-26 22:36:13 -08:00
da321e180d Fix the "create" action with the "--dry-run" flag querying for databases when a PostgreSQL/MySQL "all" database is configured.
All checks were successful
continuous-integration/drone/push Build is passing
2023-02-26 22:15:12 -08:00
c6582e1171 Internally support new Borg 2.0.0b5 "--filter" status characters / item flags for the "create" action.
All checks were successful
continuous-integration/drone/push Build is passing
2023-02-26 17:17:25 -08:00
9b83afe491 With the "create" action, only one of "--list" ("--files") and "--progress" flags can be used.
All checks were successful
continuous-integration/drone/push Build is passing
2023-02-26 17:05:56 -08:00
8a9d5d93f5 Add ntfy authentication to NEWS.
All checks were successful
continuous-integration/drone/push Build is passing
2023-02-25 14:23:42 -08:00
9b071ff92f Make the auth logic more explicit and warnings if necessary 2023-02-25 20:04:39 +01:00
d80e716822 Add authentication to the ntfy hook 2023-02-24 17:35:53 +01:00
418ebc8843 Add MySQL database hook "add_drop_database" configuration option to control whether dumped MySQL databases get dropped right before restore (#642).
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2023-02-20 15:32:47 -08:00
f5a448c7c2 Fix for potential data loss (data not getting backed up) when dumping large "directory" format PostgreSQL/MongoDB databases (#643).
All checks were successful
continuous-integration/drone/push Build is passing
2023-02-20 15:18:51 -08:00
30cca62d09 Add configuration options for database command customization (#630).
Some checks failed
continuous-integration/drone/push Build is failing
2023-01-26 14:59:17 -08:00
0e6b2c6773 Optionally dump "all" PostgreSQL databases to separate files instead of one combined dump file (#438, #560).
All checks were successful
continuous-integration/drone/push Build is passing
2023-01-25 23:31:07 -08:00
palto42
fd7ad86daa
conditional warning for excluding special files 2023-01-03 21:53:51 +01:00
6f3b23c79d Lowercase borgmatic in documentation.
All checks were successful
continuous-integration/drone/push Build is passing
2022-12-23 14:12:48 -08:00
116f1ab989 add borgmatic minimum version to compact docs 2022-12-23 13:32:01 -08:00
5e15c9f2bc Fix traceback when include merging on ARM64 (#622).
All checks were successful
continuous-integration/drone/push Build is passing
2022-12-23 10:07:53 -08:00
f67c544be6 Optionally dump "all" PostgreSQL databases to separate files instead of one combined dump file (#438, #560).
All checks were successful
continuous-integration/drone/push Build is passing
2022-12-15 22:59:42 -08:00
c657764367 Fix logs that interfere with JSON output by making warnings go to stderr instead of stdout (#602).
All checks were successful
continuous-integration/drone/push Build is passing
2022-12-02 12:12:10 -08:00
fd39f54df7 Code formatting.
All checks were successful
continuous-integration/drone/push Build is passing
2022-11-18 08:35:01 -08:00
ca7e18bb29
Override PostgreSQL dump/restore commands via configuration options (#311).
Merge pull request #49 from jpaniagualaconich/specify-pg-dump-restore-commands
2022-11-18 08:33:14 -08:00
6975a5b155 Fix "data" consistency check to support "check_last" and consistency "prefix" options (#611).
All checks were successful
continuous-integration/drone/push Build is passing
2022-11-17 10:19:48 -08:00
Javier Paniagua
faf682ca35 specify pg dump/restore commands (#311) 2022-11-06 11:12:53 +01:00
89500df429 Fix traceback when a configuration section is present but lacking any options (#604).
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-23 13:56:03 -07:00
9c42e7e817 Fix regression in which "check" action errored on certain systems (#597, #598).
Some checks failed
continuous-integration/drone/push Build is failing
continuous-integration/drone/tag Build is passing
2022-10-14 16:19:26 -07:00
953277a066 Fix special file detection when broken symlinks are encountered (#596).
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-14 09:41:08 -07:00
c9742e1d04 Code formatting.
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-12 10:52:32 -07:00
906da838ef Add missing break-lock action command-line help (#357).
Some checks failed
continuous-integration/drone/push Build is failing
2022-10-12 10:48:10 -07:00
d7f1c10c8c To prevent Borg hangs, unconditionally delete stale named pipes before dumping databases (#360).
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-12 10:26:09 -07:00
a31ce337e9 Skip auto-exclusion of special files when user explicitly sets read_special to true (#587).
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-06 11:07:43 -07:00
c31702d092 Fix for potential data loss with "patterns_from". Also, display excluded files (#590).
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-04 22:57:18 -07:00
ba8fbe7a44 Add "break-lock" action for removing any repository and cache locks leftover from Borg aborting (#357).
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-04 13:42:18 -07:00
2774c2e4c0 Add support for Borg 2's "--match-archives" flag (replaces "--glob-archives") (#591).
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-03 22:50:37 -07:00
ae036aebd7 When the "read_special" option is true or database hooks are enabled, auto-exclude special files for a "create" action to prevent Borg from hanging (#587).
All checks were successful
continuous-integration/drone/push Build is passing
2022-10-03 12:58:13 -07:00
ac7c7d4036 Warn when ignoring a configured "read_special" value of false, as true is needed when database hooks are enabled (#587).
Some checks failed
continuous-integration/drone/push Build is failing
2022-09-20 13:52:13 -07:00
679bb839d7 Fix hang when database hooks are enabled and "patterns" contains a parent directory of "~/.borgmatic" (#582).
All checks were successful
continuous-integration/drone/push Build is passing
2022-09-08 10:16:42 -07:00
9e64d847ef Fix regression in which "borgmatic info --archive ..." showed repository info instead of archive info with Borg 1 (#577).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-30 20:42:42 -07:00
61fb275896 Fix duplicate-appearing log entries for "list" action. 2022-08-30 20:29:26 -07:00
87c97b7568 Fixed spurious, intermittent test failures related to command execution and logging.
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-28 09:06:06 -07:00
c46f2b8508 Fix conflict between "patterns" and "source_directories" (#574), make "source_directories" optional (#542). 2022-08-25 11:55:34 -07:00
a274c0dbf7 In generate-borgmatic-config, indicate that the example options are exhaustive.
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-24 09:53:54 -07:00
ef7e95e22a Fix end-to-end tests.
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-21 23:29:13 -07:00
3be99de5b1 Update "repositories" examples in configuration to use ssh:// style syntax.
Some checks failed
continuous-integration/drone/push Build is failing
2022-08-21 22:40:31 -07:00
317dc7fbce Add "before_actions" and "after_actions" command hooks that run before/after all the actions for each repository, update docs to cover per-repository configurations (#463).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-21 21:48:37 -07:00
462326406e Drop only-style actions like "--create", rename "prune --files" to "prune --list", and add "--list" alias to "create" and "export-tar" (#571).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-21 14:25:16 -07:00
f9d7faf884 Fix mount action to work without archive again (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-18 23:33:05 -07:00
7dee6194a2 Add new "transfer" action for Borg 2 (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-18 23:06:51 -07:00
43d711463c Add additional command-line flags to rcreate action (#557). 2022-08-18 14:28:12 -07:00
b40e9b7da2 Ignore archive filter parameters passed to list action when --archive is given (#557).
All checks were successful
continuous-integration/drone Build is passing
2022-08-18 09:59:48 -07:00
89d201c8ff Fleshing out NEWS for the Borg 2 changes.
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-17 21:54:00 -07:00
f47c98c4a5 Rename several configuration options to match Borg 2 (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-17 21:14:58 -07:00
3b6ed06686 Add --other-repo flag to rcreate action (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-17 17:33:09 -07:00
57009e22b5 Use flag-related utility functions in info action (#557).
Some checks are pending
continuous-integration/drone/push Build is running
2022-08-17 17:11:02 -07:00
3ab7a3b64a Replace use of --prefix with --glob-archives in info action (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-17 15:36:19 -07:00
596dd49cf5 Use --glob-archives instead of --prefix on rlist command (#557).
Some checks are pending
continuous-integration/drone/push Build is running
2022-08-17 14:26:35 -07:00
28d847b8b1 Warn and tranform on non-ssh://-style repositories (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-17 10:13:11 -07:00
30abd0e3de Update borg action for Borg 2 support (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-16 09:30:00 -07:00
f36e38ec20 Update mount action for Borg 2 support (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-15 19:32:37 -07:00
d807ce095e Update export-tar action for Borg 2 support (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-15 17:34:12 -07:00
7626fe1189 Disallow borg list --json with --archive or --find (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-15 15:40:28 -07:00
cc04bf57df Update list action for Borg 2 support, add rinfo action, and update extract consistency check for Borg 2.
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-15 15:04:40 -07:00
cce6d56661 Update extract action for Borg 2 support (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-13 23:07:29 -07:00
a05d0f378e Factor out repository/archive flags formatting code from create action (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-13 22:50:14 -07:00
94321aec7a Update compact action for Borg 2 support (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-13 22:07:15 -07:00
4a55749bd2 Update prune action for Borg 2 support (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-13 17:26:51 -07:00
2898e63166 Update create action for Borg 2 support (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-12 23:54:13 -07:00
c7176bd00a Add rinfo action for Borg 2 support (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-12 23:06:56 -07:00
647ecdac29 Borg 2 support in borgmatic check action (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-12 15:46:33 -07:00
e7a8acfb96 Add missing rinfo action source files (#557).
All checks were successful
continuous-integration/drone/push Build is passing
2022-08-12 14:59:03 -07:00
622caa0c21 Support for Borg 2's rcreate and rinfo sub-commands (#557).
Some checks failed
continuous-integration/drone/push Build is failing
2022-08-12 14:53:20 -07:00
9aece3936a Modify "mount" and "extract" actions to require the "--repository" flag when multiple repositories are configured (#566).
All checks were successful
continuous-integration/drone/push Build is passing
2022-07-25 11:30:02 -07:00
c7e4e6f6c9 Add Healthchecks "verify_tls" option to NEWS.
All checks were successful
continuous-integration/drone/push Build is passing
2022-07-23 23:16:06 -07:00
bcad0de1a4
Add verify_tls option for Healthchecks to optionally disable TLS verification. 2022-07-23 23:11:41 -07:00
Uli
5c6407047f feat: add verify_tls flag for Healthchecks 2022-07-24 07:37:00 +02:00
6ddae20fa1 Fix handling of "repository" and "data" consistency checks to prevent invalid Borg flags (#565).
All checks were successful
continuous-integration/drone/push Build is passing
2022-07-23 21:02:21 -07:00
16066942e3 Fix traceback with "create" action and "--json" flag when a database hook is configured (#563).
All checks were successful
continuous-integration/drone/push Build is passing
2022-07-19 10:25:10 -07:00
e85d551eac Fix all database hooks to error when the requested database to restore isn't present in the Borg archive (#560).
All checks were successful
continuous-integration/drone/push Build is passing
2022-07-06 23:21:24 -07:00
c0f48e1071 Fix command-line "--override" flag to continue supporting old configuration file formats (#561).
All checks were successful
continuous-integration/drone/push Build is passing
2022-07-06 18:14:44 -07:00
457ed80744 Fix environment variable plumbing so options in one configuration file aren't used for others (#555).
All checks were successful
continuous-integration/drone/push Build is passing
2022-06-30 13:42:17 -07:00
10723efc68 Fix all monitoring hooks to warn if the server returns an HTTP 4xx error (#554).
All checks were successful
continuous-integration/drone/push Build is passing
2022-06-29 21:19:40 -07:00
bd4d109009 Fix logging to include the full traceback when Borg experiences an internal error (#553).
All checks were successful
continuous-integration/drone/push Build is passing
2022-06-28 13:38:24 -07:00
d372a86fe6 Code formatting.
Some checks reported errors
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build encountered an error
2022-06-23 10:41:04 -07:00
b63c854509 Fix escaped environment variable in configuration
- when an env variable is escaped in the configuration file, we expect
  not to resolve it and remove the escape char `\`
2022-06-17 09:50:56 +02:00
6d76e8e5cb Code formatting.
All checks were successful
continuous-integration/drone/push Build is passing
2022-06-16 14:21:18 -07:00
aecb6fcd74 Code style, rename command-line flag, and move new code into its own file (#546)
Some checks failed
continuous-integration/drone/push Build is failing
2022-06-16 11:35:24 -07:00
97b5cd089d Allow environment variable resolution in configuration file
- all string fields containing an environment variable like ${FOO} will
  be resolved
- supported format ${FOO}, ${FOO:-bar} and ${FOO-bar} to allow default
  values if variable is not present in environment
- add --no-env argument for CLI to disable the feature which is enabled
  by default

Resolves: #546
2022-06-16 18:52:54 +02:00
f2c2f3139e Add periods to ntfy config descriptions.
All checks were successful
continuous-integration/drone/push Build is passing
2022-06-10 09:42:41 -07:00