returned non-zero exit status 2 #519

Closed
opened 2022-04-11 18:01:19 +00:00 by jacobo · 20 comments

What I'm trying to do and why

when run borgmatic

Steps to reproduce (if a bug)

Include (sanitized) borgmatic configuration files if applicable.

Actual behavior (if a bug)

starting backup
c036v49y@c036v49y.repo.borgbase.com:repo: Error running actions for repository
Command 'borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- xxxxxxxrepo.borgbase.com:repo' returned non-zero exit status 2.

also


Starting backup
xxxxxx.borgbase.com:repo: Error running actions for repository
Command 'borg create --exclude-from /tmp/tmp_j14o2xa --exclude-caches --exclude-if-present .nobackup --compression auto,zstd --one-file-system xxxxx.repo.borgbase.com:repo::{hostname}-{now} /var/www' returned non-zero exit status 2.

Environment

borgmatic version: [version here]

1.5.13

borgmatic installation method: [e.g., Debian package, Docker container, etc.]

pip

Borg version: [version here]

borg 1.1.9

Python version: [version here]

Python 3.7.3

operating system and version: [OS here]

Debia buster

#### What I'm trying to do and why when run borgmatic #### Steps to reproduce (if a bug) Include (sanitized) borgmatic configuration files if applicable. #### Actual behavior (if a bug) ``` starting backup c036v49y@c036v49y.repo.borgbase.com:repo: Error running actions for repository Command 'borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- xxxxxxxrepo.borgbase.com:repo' returned non-zero exit status 2. ``` also ``` Starting backup xxxxxx.borgbase.com:repo: Error running actions for repository Command 'borg create --exclude-from /tmp/tmp_j14o2xa --exclude-caches --exclude-if-present .nobackup --compression auto,zstd --one-file-system xxxxx.repo.borgbase.com:repo::{hostname}-{now} /var/www' returned non-zero exit status 2. ``` #### Environment **borgmatic version:** [version here] 1.5.13 **borgmatic installation method:** [e.g., Debian package, Docker container, etc.] pip **Borg version:** [version here] borg 1.1.9 **Python version:** [version here] Python 3.7.3 **operating system and version:** [OS here] Debia buster
Owner

Have you tried increasing borgmatic's verbosity, e.g. with the --verbosity 2 flag to show more information in the logs? If that doesn't help, you can also try running the borg command directly (e.g. copy and paste the command borgmatic is showing) to see if there's a more useful error message. You shouldn't have to do that, but borgmatic may be suppressing something.

Have you tried increasing borgmatic's verbosity, e.g. with the `--verbosity 2` flag to show more information in the logs? If that doesn't help, you can also try running the `borg` command directly (e.g. copy and paste the command borgmatic is showing) to see if there's a more useful error message. You shouldn't *have* to do that, but borgmatic may be suppressing something.
Author

I will try it. But it happens time to time by cron.

I will try it. But it happens time to time by cron.
Owner

You can up the verbosity when borgmatic is run via cron as well! Same flags.

When you do get these errors from cron, is there anything else of note in the borgmatic logs? Feel free to paste here or link to a paste of your logs elsewhere.

You can up the verbosity when borgmatic is run via cron as well! Same flags. When you do get these errors from cron, is there anything else of note in the borgmatic logs? Feel free to paste here or link to a paste of your logs elsewhere.
witten added the
question / support
label 2022-04-11 20:21:33 +00:00
Author

borg create --exclude-from /tmp/tmpm6ad0ity --exclude-caches --exclude-if-present .nobackup --compression auto,zstd --one-file-system --debug --show-rc xxxxx@xxxxx.repo.borgbase.com:repo::{hostname}-{now} /var/www

Traceback (most recent call last):
  File "/usr/bin/borg", line 11, in <module>
    load_entry_point('borgbackup==1.1.9', 'console_scripts', 'borg')()
  File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4444, in main
    args = archiver.get_args(sys.argv, os.environ.get('SSH_ORIGINAL_COMMAND'))
  File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4279, in get_args
    result = self.parse_args(argv[1:])
  File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4302, in parse_args
    args = parser.parse_args(args or ['-h'])
  File "/usr/lib/python3.7/argparse.py", line 1758, in parse_args
    args, argv = self.parse_known_args(args, namespace)
  File "/usr/lib/python3.7/argparse.py", line 1790, in parse_known_args
    namespace, args = self._parse_known_args(args, namespace)
  File "/usr/lib/python3.7/argparse.py", line 1978, in _parse_known_args
    positionals_end_index = consume_positionals(start_index)
  File "/usr/lib/python3.7/argparse.py", line 1955, in consume_positionals
    take_action(action, args)
  File "/usr/lib/python3.7/argparse.py", line 1864, in take_action
    action(self, namespace, argument_values, option_string)
  File "/usr/lib/python3.7/argparse.py", line 1161, in __call__
    subnamespace, arg_strings = parser.parse_known_args(arg_strings, None)
  File "/usr/lib/python3.7/argparse.py", line 1790, in parse_known_args
    namespace, args = self._parse_known_args(args, namespace)
  File "/usr/lib/python3.7/argparse.py", line 1996, in _parse_known_args
    start_index = consume_optional(start_index)
  File "/usr/lib/python3.7/argparse.py", line 1936, in consume_optional
    take_action(action, args, option_string)
  File "/usr/lib/python3.7/argparse.py", line 1864, in take_action
    action(self, namespace, argument_values, option_string)
  File "/usr/lib/python3/dist-packages/borg/patterns.py", line 56, in __call__
    with open(filename) as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpm6ad0ity'
**borg create --exclude-from /tmp/tmpm6ad0ity --exclude-caches --exclude-if-present .nobackup --compression auto,zstd --one-file-system --debug --show-rc xxxxx@xxxxx.repo.borgbase.com:repo::{hostname}-{now} /var/www** ``` Traceback (most recent call last): File "/usr/bin/borg", line 11, in <module> load_entry_point('borgbackup==1.1.9', 'console_scripts', 'borg')() File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4444, in main args = archiver.get_args(sys.argv, os.environ.get('SSH_ORIGINAL_COMMAND')) File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4279, in get_args result = self.parse_args(argv[1:]) File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4302, in parse_args args = parser.parse_args(args or ['-h']) File "/usr/lib/python3.7/argparse.py", line 1758, in parse_args args, argv = self.parse_known_args(args, namespace) File "/usr/lib/python3.7/argparse.py", line 1790, in parse_known_args namespace, args = self._parse_known_args(args, namespace) File "/usr/lib/python3.7/argparse.py", line 1978, in _parse_known_args positionals_end_index = consume_positionals(start_index) File "/usr/lib/python3.7/argparse.py", line 1955, in consume_positionals take_action(action, args) File "/usr/lib/python3.7/argparse.py", line 1864, in take_action action(self, namespace, argument_values, option_string) File "/usr/lib/python3.7/argparse.py", line 1161, in __call__ subnamespace, arg_strings = parser.parse_known_args(arg_strings, None) File "/usr/lib/python3.7/argparse.py", line 1790, in parse_known_args namespace, args = self._parse_known_args(args, namespace) File "/usr/lib/python3.7/argparse.py", line 1996, in _parse_known_args start_index = consume_optional(start_index) File "/usr/lib/python3.7/argparse.py", line 1936, in consume_optional take_action(action, args, option_string) File "/usr/lib/python3.7/argparse.py", line 1864, in take_action action(self, namespace, argument_values, option_string) File "/usr/lib/python3/dist-packages/borg/patterns.py", line 56, in __call__ with open(filename) as f: FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpm6ad0ity' ```
Owner

Ah, unfortunately this likely isn't the same error that's tripping up borgmatic. In this case, Borg is failing to read the temporary excludes file that borgmatic uses to pass your configured excludes to Borg. But that probably wouldn't be the case when run via borgmatic. If you leave out --exclude-from /tmp/tmpm6ad0ity and run the same command, do you get any error? (Note that your excludes won't be passed in that way!)

Ah, unfortunately this likely isn't the same error that's tripping up borgmatic. In this case, Borg is failing to read the temporary excludes file that borgmatic uses to pass your configured excludes to Borg. But that probably wouldn't be the case when run via borgmatic. If you leave out `--exclude-from /tmp/tmpm6ad0ity` and run the same command, do you get any error? (Note that your excludes won't be passed in that way!)
Author

if i leave out --exclude-from /tmp/tmpm6ad0ity it works.

if i leave out `--exclude-from /tmp/tmpm6ad0ity` it works.
Owner

Okay, in that case the issue might be with borgmatic. I'd recommend to going back to your borgmatic cron invocation and adding --verbosity 2 and seeing if the resulting cron error logs show anything useful.

Okay, in that case the issue might be with borgmatic. I'd recommend to going back to your borgmatic cron invocation and adding `--verbosity 2` and seeing if the resulting cron error logs show anything useful.
Author

Hi

I have two repos.

Apr 17 22:00:01 host CRON[27005]: (root) CMD (/usr/local/bin/borgmatic --syslog-verbosity 2)
Apr 17 22:00:02 host borgmatic: DEBUG Ensuring legacy configuration is upgraded
Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for pre-everything hook
Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Calling healthchecks hook function initialize_monitor
Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for pre-prune hook
Apr 17 22:00:02 host borgmatic: INFO /etc/borgmatic/config.yaml: Running command for pre-backup hook
Apr 17 22:00:02 host borgmatic: DEBUG echo "`date` - Starting backup"
Apr 17 22:00:02 host borgmatic: WARNING Sun Apr 17 22:00:02 UTC 2022 - Starting backup
Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for pre-check hook
Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Calling healthchecks hook function ping_monitor
Apr 17 22:00:02 host borgmatic: INFO /etc/borgmatic/config.yaml: Pinging Healthchecks start
Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Using Healthchecks ping URL 
Apr 17 22:00:02 host borgmatic: INFO c036v49y@c036v49y.repo.server.tld:repo: Pruning archives
Apr 17 22:00:02 host borgmatic: DEBUG borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- --debug --show-rc c036v49y@c036v49y.repo.server.tld:repo
Apr 17 22:00:03 host borgmatic: INFO using builtin fallback logging configuration
Apr 17 22:00:03 host borgmatic: INFO 35 self tests completed in 0.26 seconds
Apr 17 22:00:03 host borgmatic: INFO SSH command line: ['ssh', 'c036v49y@c036v49y.repo.server.tld', 'borg', 'serve', '--umask=077', '--debug']
Apr 17 22:00:06 host borgmatic: INFO Remote: using builtin fallback logging configuration
Apr 17 22:00:06 host borgmatic: INFO Remote: borg selftest disabled via BORG_SELFTEST env variable
Apr 17 22:00:06 host borgmatic: INFO Remote: using builtin fallback logging configuration
Apr 17 22:00:06 host borgmatic: INFO Remote: Initialized logging system for JSON-based protocol
Apr 17 22:00:06 host borgmatic: INFO Remote: Resolving repository path b'repo'
Apr 17 22:00:06 host borgmatic: INFO Remote: Resolved repository path to '/srv/repos/c036v49y/repo'
Apr 17 22:00:06 host borgmatic: INFO Remote: Verified integrity of /srv/repos/c036v49y/repo/index.1220
Apr 17 22:00:06 host borgmatic: INFO TAM-verified manifest
Apr 17 22:00:06 host borgmatic: INFO security: read previous location 'ssh://c036v49y@c036v49y.repo.server.tld/./repo'
Apr 17 22:00:06 host borgmatic: INFO security: read manifest timestamp '2022-04-16T22:00:10.194179'
Apr 17 22:00:06 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-16T22:00:10.194179
Apr 17 22:00:06 host borgmatic: INFO security: repository checks ok, allowing access
Apr 17 22:00:06 host borgmatic: INFO Verified integrity of /root/.cache/borg/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d/chunks
Apr 17 22:00:06 host borgmatic: INFO security: read previous location 'ssh://c036v49y@c036v49y.repo.server.tld/./repo'
Apr 17 22:00:06 host borgmatic: INFO security: read manifest timestamp '2022-04-16T22:00:10.194179'
Apr 17 22:00:06 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-16T22:00:10.194179
Apr 17 22:00:06 host borgmatic: INFO security: repository checks ok, allowing access
Apr 17 22:00:06 host borgmatic: INFO Remote: Cleaned up 0 uncommitted segment files (== everything after segment 1220).
Apr 17 22:00:06 host borgmatic: INFO Remote: Verified integrity of /srv/repos/c036v49y/repo/hints.1220
Apr 17 22:00:06 host borgmatic: INFO Remote: Storage quota: 1.85 GB out of 320.73 GB used.
Apr 17 22:00:06 host borgmatic: INFO Remote: check_free_space: required bytes 6334518, free bytes 9537111556096
Apr 17 22:00:07 host borgmatic: INFO Remote: Storage quota: 1.85 GB out of 320.73 GB used.
Apr 17 22:00:07 host borgmatic: INFO security: saving state for 7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d to /root/.config/borg/security/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d
Apr 17 22:00:07 host borgmatic: INFO security: current location   ssh://c036v49y@c036v49y.repo.server.tld/./repo
Apr 17 22:00:07 host borgmatic: INFO security: key type           5
Apr 17 22:00:07 host borgmatic: INFO security: manifest timestamp 2022-04-17T22:00:06.889025
Apr 17 22:00:07 host borgmatic: INFO RemoteRepository: 2.23 kB bytes sent, 283.57 kB bytes received, 23 messages sent
Apr 17 22:00:07 host borgmatic: INFO terminating with success status, rc 0
Apr 17 22:00:07 host borgmatic: INFO c036v49y@c036v49y.repo.server.tld:repo: Creating archive
Apr 17 22:00:07 host borgmatic: DEBUG borg create --exclude-from /tmp/tmppbpiy_k5 --exclude-caches --exclude-if-present .nobackup --compression auto,zstd --one-file-system --debug --show-rc c036v49y@c036v49y.repo.server.tld:repo::{hostname}-{now} /var/www
Apr 17 22:00:07 host borgmatic: INFO using builtin fallback logging configuration
Apr 17 22:00:07 host borgmatic: INFO 35 self tests completed in 0.18 seconds
Apr 17 22:00:07 host borgmatic: INFO SSH command line: ['ssh', 'c036v49y@c036v49y.repo.server.tld', 'borg', 'serve', '--umask=077', '--debug']
Apr 17 22:00:09 host borgmatic: INFO Remote: using builtin fallback logging configuration
Apr 17 22:00:09 host borgmatic: INFO Remote: borg selftest disabled via BORG_SELFTEST env variable
Apr 17 22:00:09 host borgmatic: INFO Remote: using builtin fallback logging configuration
Apr 17 22:00:09 host borgmatic: INFO Remote: Initialized logging system for JSON-based protocol
Apr 17 22:00:09 host borgmatic: INFO Remote: Resolving repository path b'repo'
Apr 17 22:00:09 host borgmatic: INFO Remote: Resolved repository path to '/srv/repos/c036v49y/repo'
Apr 17 22:00:09 host borgmatic: INFO Remote: Verified integrity of /srv/repos/c036v49y/repo/index.1224
Apr 17 22:00:09 host borgmatic: INFO TAM-verified manifest
Apr 17 22:00:10 host borgmatic: INFO security: read previous location 'ssh://c036v49y@c036v49y.repo.server.tld/./repo'
Apr 17 22:00:10 host borgmatic: INFO security: read manifest timestamp '2022-04-17T22:00:06.889025'
Apr 17 22:00:10 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-17T22:00:06.889025
Apr 17 22:00:10 host borgmatic: INFO security: repository checks ok, allowing access
Apr 17 22:00:10 host borgmatic: INFO Creating archive at "c036v49y@c036v49y.repo.server.tld:repo::{hostname}-{now}"
Apr 17 22:00:10 host borgmatic: INFO Verified integrity of /root/.cache/borg/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d/chunks
Apr 17 22:00:10 host borgmatic: INFO Reading files cache ...
Apr 17 22:00:10 host borgmatic: INFO Verified integrity of /root/.cache/borg/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d/files
Apr 17 22:00:10 host borgmatic: INFO security: read previous location 'ssh://c036v49y@c036v49y.repo.server.tld/./repo'
Apr 17 22:00:10 host borgmatic: INFO security: read manifest timestamp '2022-04-17T22:00:06.889025'
Apr 17 22:00:10 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-17T22:00:06.889025
Apr 17 22:00:10 host borgmatic: INFO security: repository checks ok, allowing access
Apr 17 22:00:10 host borgmatic: INFO Processing files ...
Apr 17 22:00:11 host borgmatic: INFO Remote: Cleaned up 0 uncommitted segment files (== everything after segment 1224).
Apr 17 22:00:11 host borgmatic: INFO Remote: Verified integrity of /srv/repos/c036v49y/repo/hints.1224
Apr 17 22:00:11 host borgmatic: INFO Remote: Storage quota: 1.85 GB out of 320.73 GB used.
Apr 17 22:00:11 host borgmatic: INFO Remote: check_free_space: required bytes 6334588, free bytes 9537133481984
Apr 17 22:00:11 host borgmatic: INFO Remote: Storage quota: 1.85 GB out of 320.73 GB used.
Apr 17 22:00:11 host borgmatic: INFO security: saving state for 7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d to /root/.config/borg/security/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d
Apr 17 22:00:11 host borgmatic: INFO security: current location   ssh://c036v49y@c036v49y.repo.server.tld/./repo
Apr 17 22:00:11 host borgmatic: INFO security: key type           5
Apr 17 22:00:11 host borgmatic: INFO security: manifest timestamp 2022-04-17T22:00:11.046369
Apr 17 22:00:11 host borgmatic: INFO RemoteRepository: 284.82 kB bytes sent, 4.58 kB bytes received, 16 messages sent
Apr 17 22:00:11 host borgmatic: INFO terminating with success status, rc 0
Apr 17 22:00:11 host borgmatic: INFO c036v49y@c036v49y.repo.server.tld:repo: Running consistency checks
Apr 17 22:00:11 host borgmatic: INFO q4nudxni@q4nudxni.repo.server.tld:repo: Pruning archives
Apr 17 22:00:11 host borgmatic: DEBUG borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- --debug --show-rc q4nudxni@q4nudxni.repo.server.tld:repo
Apr 17 22:00:11 host borgmatic: INFO using builtin fallback logging configuration
Apr 17 22:00:11 host borgmatic: INFO 35 self tests completed in 0.14 seconds
Apr 17 22:00:11 host borgmatic: INFO SSH command line: ['ssh', 'q4nudxni@q4nudxni.repo.server.tld', 'borg', 'serve', '--umask=077', '--debug']
Apr 17 22:00:15 host borgmatic: INFO Remote: using builtin fallback logging configuration
Apr 17 22:00:16 host borgmatic: INFO Remote: borg selftest disabled via BORG_SELFTEST env variable
Apr 17 22:00:16 host borgmatic: INFO Remote: using builtin fallback logging configuration
Apr 17 22:00:16 host borgmatic: INFO Remote: Initialized logging system for JSON-based protocol
Apr 17 22:00:16 host borgmatic: INFO Remote: Resolving repository path b'repo'
Apr 17 22:00:17 host borgmatic: INFO Remote: Resolved repository path to '/srv/repos/q4nudxni/repo'
Apr 17 22:00:17 host borgmatic: INFO Remote: Verified integrity of /srv/repos/q4nudxni/repo/index.1312
Apr 17 22:00:17 host borgmatic: INFO TAM-verified manifest
Apr 17 22:00:17 host borgmatic: INFO security: read previous location 'ssh://q4nudxni@q4nudxni.repo.server.tld/./repo'
Apr 17 22:00:17 host borgmatic: INFO security: read manifest timestamp '2022-04-16T22:00:19.580248'
Apr 17 22:00:17 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-16T22:00:19.580248
Apr 17 22:00:17 host borgmatic: INFO security: repository checks ok, allowing access
Apr 17 22:00:17 host borgmatic: INFO Verified integrity of /root/.cache/borg/e84b398a9bb8847eae7e3d1881949748053d535f6c5d79289aac71bf64f05838/chunks
Apr 17 22:00:17 host borgmatic: INFO security: read previous location 'ssh://q4nudxni@q4nudxni.repo.server.tld/./repo'
Apr 17 22:00:17 host borgmatic: INFO security: read manifest timestamp '2022-04-16T22:00:19.580248'
Apr 17 22:00:17 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-16T22:00:19.580248
Apr 17 22:00:17 host borgmatic: INFO security: repository checks ok, allowing access


Hi I have two repos. ``` Apr 17 22:00:01 host CRON[27005]: (root) CMD (/usr/local/bin/borgmatic --syslog-verbosity 2) Apr 17 22:00:02 host borgmatic: DEBUG Ensuring legacy configuration is upgraded Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for pre-everything hook Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Calling healthchecks hook function initialize_monitor Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for pre-prune hook Apr 17 22:00:02 host borgmatic: INFO /etc/borgmatic/config.yaml: Running command for pre-backup hook Apr 17 22:00:02 host borgmatic: DEBUG echo "`date` - Starting backup" Apr 17 22:00:02 host borgmatic: WARNING Sun Apr 17 22:00:02 UTC 2022 - Starting backup Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for pre-check hook Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Calling healthchecks hook function ping_monitor Apr 17 22:00:02 host borgmatic: INFO /etc/borgmatic/config.yaml: Pinging Healthchecks start Apr 17 22:00:02 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Using Healthchecks ping URL Apr 17 22:00:02 host borgmatic: INFO c036v49y@c036v49y.repo.server.tld:repo: Pruning archives Apr 17 22:00:02 host borgmatic: DEBUG borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- --debug --show-rc c036v49y@c036v49y.repo.server.tld:repo Apr 17 22:00:03 host borgmatic: INFO using builtin fallback logging configuration Apr 17 22:00:03 host borgmatic: INFO 35 self tests completed in 0.26 seconds Apr 17 22:00:03 host borgmatic: INFO SSH command line: ['ssh', 'c036v49y@c036v49y.repo.server.tld', 'borg', 'serve', '--umask=077', '--debug'] Apr 17 22:00:06 host borgmatic: INFO Remote: using builtin fallback logging configuration Apr 17 22:00:06 host borgmatic: INFO Remote: borg selftest disabled via BORG_SELFTEST env variable Apr 17 22:00:06 host borgmatic: INFO Remote: using builtin fallback logging configuration Apr 17 22:00:06 host borgmatic: INFO Remote: Initialized logging system for JSON-based protocol Apr 17 22:00:06 host borgmatic: INFO Remote: Resolving repository path b'repo' Apr 17 22:00:06 host borgmatic: INFO Remote: Resolved repository path to '/srv/repos/c036v49y/repo' Apr 17 22:00:06 host borgmatic: INFO Remote: Verified integrity of /srv/repos/c036v49y/repo/index.1220 Apr 17 22:00:06 host borgmatic: INFO TAM-verified manifest Apr 17 22:00:06 host borgmatic: INFO security: read previous location 'ssh://c036v49y@c036v49y.repo.server.tld/./repo' Apr 17 22:00:06 host borgmatic: INFO security: read manifest timestamp '2022-04-16T22:00:10.194179' Apr 17 22:00:06 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-16T22:00:10.194179 Apr 17 22:00:06 host borgmatic: INFO security: repository checks ok, allowing access Apr 17 22:00:06 host borgmatic: INFO Verified integrity of /root/.cache/borg/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d/chunks Apr 17 22:00:06 host borgmatic: INFO security: read previous location 'ssh://c036v49y@c036v49y.repo.server.tld/./repo' Apr 17 22:00:06 host borgmatic: INFO security: read manifest timestamp '2022-04-16T22:00:10.194179' Apr 17 22:00:06 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-16T22:00:10.194179 Apr 17 22:00:06 host borgmatic: INFO security: repository checks ok, allowing access Apr 17 22:00:06 host borgmatic: INFO Remote: Cleaned up 0 uncommitted segment files (== everything after segment 1220). Apr 17 22:00:06 host borgmatic: INFO Remote: Verified integrity of /srv/repos/c036v49y/repo/hints.1220 Apr 17 22:00:06 host borgmatic: INFO Remote: Storage quota: 1.85 GB out of 320.73 GB used. Apr 17 22:00:06 host borgmatic: INFO Remote: check_free_space: required bytes 6334518, free bytes 9537111556096 Apr 17 22:00:07 host borgmatic: INFO Remote: Storage quota: 1.85 GB out of 320.73 GB used. Apr 17 22:00:07 host borgmatic: INFO security: saving state for 7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d to /root/.config/borg/security/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d Apr 17 22:00:07 host borgmatic: INFO security: current location ssh://c036v49y@c036v49y.repo.server.tld/./repo Apr 17 22:00:07 host borgmatic: INFO security: key type 5 Apr 17 22:00:07 host borgmatic: INFO security: manifest timestamp 2022-04-17T22:00:06.889025 Apr 17 22:00:07 host borgmatic: INFO RemoteRepository: 2.23 kB bytes sent, 283.57 kB bytes received, 23 messages sent Apr 17 22:00:07 host borgmatic: INFO terminating with success status, rc 0 Apr 17 22:00:07 host borgmatic: INFO c036v49y@c036v49y.repo.server.tld:repo: Creating archive Apr 17 22:00:07 host borgmatic: DEBUG borg create --exclude-from /tmp/tmppbpiy_k5 --exclude-caches --exclude-if-present .nobackup --compression auto,zstd --one-file-system --debug --show-rc c036v49y@c036v49y.repo.server.tld:repo::{hostname}-{now} /var/www Apr 17 22:00:07 host borgmatic: INFO using builtin fallback logging configuration Apr 17 22:00:07 host borgmatic: INFO 35 self tests completed in 0.18 seconds Apr 17 22:00:07 host borgmatic: INFO SSH command line: ['ssh', 'c036v49y@c036v49y.repo.server.tld', 'borg', 'serve', '--umask=077', '--debug'] Apr 17 22:00:09 host borgmatic: INFO Remote: using builtin fallback logging configuration Apr 17 22:00:09 host borgmatic: INFO Remote: borg selftest disabled via BORG_SELFTEST env variable Apr 17 22:00:09 host borgmatic: INFO Remote: using builtin fallback logging configuration Apr 17 22:00:09 host borgmatic: INFO Remote: Initialized logging system for JSON-based protocol Apr 17 22:00:09 host borgmatic: INFO Remote: Resolving repository path b'repo' Apr 17 22:00:09 host borgmatic: INFO Remote: Resolved repository path to '/srv/repos/c036v49y/repo' Apr 17 22:00:09 host borgmatic: INFO Remote: Verified integrity of /srv/repos/c036v49y/repo/index.1224 Apr 17 22:00:09 host borgmatic: INFO TAM-verified manifest Apr 17 22:00:10 host borgmatic: INFO security: read previous location 'ssh://c036v49y@c036v49y.repo.server.tld/./repo' Apr 17 22:00:10 host borgmatic: INFO security: read manifest timestamp '2022-04-17T22:00:06.889025' Apr 17 22:00:10 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-17T22:00:06.889025 Apr 17 22:00:10 host borgmatic: INFO security: repository checks ok, allowing access Apr 17 22:00:10 host borgmatic: INFO Creating archive at "c036v49y@c036v49y.repo.server.tld:repo::{hostname}-{now}" Apr 17 22:00:10 host borgmatic: INFO Verified integrity of /root/.cache/borg/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d/chunks Apr 17 22:00:10 host borgmatic: INFO Reading files cache ... Apr 17 22:00:10 host borgmatic: INFO Verified integrity of /root/.cache/borg/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d/files Apr 17 22:00:10 host borgmatic: INFO security: read previous location 'ssh://c036v49y@c036v49y.repo.server.tld/./repo' Apr 17 22:00:10 host borgmatic: INFO security: read manifest timestamp '2022-04-17T22:00:06.889025' Apr 17 22:00:10 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-17T22:00:06.889025 Apr 17 22:00:10 host borgmatic: INFO security: repository checks ok, allowing access Apr 17 22:00:10 host borgmatic: INFO Processing files ... Apr 17 22:00:11 host borgmatic: INFO Remote: Cleaned up 0 uncommitted segment files (== everything after segment 1224). Apr 17 22:00:11 host borgmatic: INFO Remote: Verified integrity of /srv/repos/c036v49y/repo/hints.1224 Apr 17 22:00:11 host borgmatic: INFO Remote: Storage quota: 1.85 GB out of 320.73 GB used. Apr 17 22:00:11 host borgmatic: INFO Remote: check_free_space: required bytes 6334588, free bytes 9537133481984 Apr 17 22:00:11 host borgmatic: INFO Remote: Storage quota: 1.85 GB out of 320.73 GB used. Apr 17 22:00:11 host borgmatic: INFO security: saving state for 7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d to /root/.config/borg/security/7859d57bdb134b52d78e30879c74ff1721f955f6b2af630b375f5859c7ea165d Apr 17 22:00:11 host borgmatic: INFO security: current location ssh://c036v49y@c036v49y.repo.server.tld/./repo Apr 17 22:00:11 host borgmatic: INFO security: key type 5 Apr 17 22:00:11 host borgmatic: INFO security: manifest timestamp 2022-04-17T22:00:11.046369 Apr 17 22:00:11 host borgmatic: INFO RemoteRepository: 284.82 kB bytes sent, 4.58 kB bytes received, 16 messages sent Apr 17 22:00:11 host borgmatic: INFO terminating with success status, rc 0 Apr 17 22:00:11 host borgmatic: INFO c036v49y@c036v49y.repo.server.tld:repo: Running consistency checks Apr 17 22:00:11 host borgmatic: INFO q4nudxni@q4nudxni.repo.server.tld:repo: Pruning archives Apr 17 22:00:11 host borgmatic: DEBUG borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- --debug --show-rc q4nudxni@q4nudxni.repo.server.tld:repo Apr 17 22:00:11 host borgmatic: INFO using builtin fallback logging configuration Apr 17 22:00:11 host borgmatic: INFO 35 self tests completed in 0.14 seconds Apr 17 22:00:11 host borgmatic: INFO SSH command line: ['ssh', 'q4nudxni@q4nudxni.repo.server.tld', 'borg', 'serve', '--umask=077', '--debug'] Apr 17 22:00:15 host borgmatic: INFO Remote: using builtin fallback logging configuration Apr 17 22:00:16 host borgmatic: INFO Remote: borg selftest disabled via BORG_SELFTEST env variable Apr 17 22:00:16 host borgmatic: INFO Remote: using builtin fallback logging configuration Apr 17 22:00:16 host borgmatic: INFO Remote: Initialized logging system for JSON-based protocol Apr 17 22:00:16 host borgmatic: INFO Remote: Resolving repository path b'repo' Apr 17 22:00:17 host borgmatic: INFO Remote: Resolved repository path to '/srv/repos/q4nudxni/repo' Apr 17 22:00:17 host borgmatic: INFO Remote: Verified integrity of /srv/repos/q4nudxni/repo/index.1312 Apr 17 22:00:17 host borgmatic: INFO TAM-verified manifest Apr 17 22:00:17 host borgmatic: INFO security: read previous location 'ssh://q4nudxni@q4nudxni.repo.server.tld/./repo' Apr 17 22:00:17 host borgmatic: INFO security: read manifest timestamp '2022-04-16T22:00:19.580248' Apr 17 22:00:17 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-16T22:00:19.580248 Apr 17 22:00:17 host borgmatic: INFO security: repository checks ok, allowing access Apr 17 22:00:17 host borgmatic: INFO Verified integrity of /root/.cache/borg/e84b398a9bb8847eae7e3d1881949748053d535f6c5d79289aac71bf64f05838/chunks Apr 17 22:00:17 host borgmatic: INFO security: read previous location 'ssh://q4nudxni@q4nudxni.repo.server.tld/./repo' Apr 17 22:00:17 host borgmatic: INFO security: read manifest timestamp '2022-04-16T22:00:19.580248' Apr 17 22:00:17 host borgmatic: INFO security: determined newest manifest timestamp as 2022-04-16T22:00:19.580248 Apr 17 22:00:17 host borgmatic: INFO security: repository checks ok, allowing access ```
Owner

Is there anything else in the logs? That looks like a successful run without any errors.. Borg is exiting each time with exit code 0 (success).

Is there anything else in the logs? That looks like a successful run without any errors.. Borg is exiting each time with exit code 0 (success).
Author

Hi, thanks!

Not really.

From borgase dashboard: "this repo was not modified within a day"

I will log one more day with syslog and go back

Hi, thanks! Not really. From borgase dashboard: "this repo was not modified within a day" I will log one more day with syslog and go back
Owner

I only see one repo in that log (c036v49y@c036v49y.repo.server.tld:repo), so unless that resolves to Borgbase, I wouldn't expect anything in Borgbase to be modified. You said you have two repos though. If you post your borgmatic configuration (with anything redacted you don't want to share), I'd be happy to take a look.

I only see one repo in that log (`c036v49y@c036v49y.repo.server.tld:repo`), so unless that resolves to Borgbase, I *wouldn't* expect anything in Borgbase to be modified. You said you have two repos though. If you post your borgmatic configuration (with anything redacted you don't want to share), I'd be happy to take a look.
Author

c036v49y and q4nudxni

config

location:
    source_directories:
        - /var/www
        

        

    one_file_system: true
    repositories:
        - xxxxxxxx@xxxxxxxxx:repo
        - xxxxxxxx@xxxxxxxxx:repo
       

    exclude_patterns:
        - '*.pyc'
        - ~/*/.cache

    exclude_caches: true
    exclude_if_present: .nobackup

storage:
    compression: auto,zstd
    encryption_passphrase: xxxxxxxx(same for two repos)
    archive_name_format: '{hostname}-{now}'

retention:
    keep_daily: 2
    keep_weekly: 4
    keep_monthly: 12
    keep_yearly: 2
    prefix: '{hostname}-'

consistency:
    checks:
        # uncomment to always do integrity checks. (takes long time for large repos)
        #- repository
        - disabled

    check_last: 3
    prefix: '{hostname}-'

hooks:
    # List of one or more shell commands or scripts to execute before creating a backup.
    before_backup:
        - echo "`date` - Starting backup"

    after_backup:
        - echo "`date` - Finished backup"
    healthchecks: url
c036v49y and q4nudxni config ``` location: source_directories: - /var/www one_file_system: true repositories: - xxxxxxxx@xxxxxxxxx:repo - xxxxxxxx@xxxxxxxxx:repo exclude_patterns: - '*.pyc' - ~/*/.cache exclude_caches: true exclude_if_present: .nobackup storage: compression: auto,zstd encryption_passphrase: xxxxxxxx(same for two repos) archive_name_format: '{hostname}-{now}' retention: keep_daily: 2 keep_weekly: 4 keep_monthly: 12 keep_yearly: 2 prefix: '{hostname}-' consistency: checks: # uncomment to always do integrity checks. (takes long time for large repos) #- repository - disabled check_last: 3 prefix: '{hostname}-' hooks: # List of one or more shell commands or scripts to execute before creating a backup. before_backup: - echo "`date` - Starting backup" after_backup: - echo "`date` - Finished backup" healthchecks: url ```
Owner

Everything there looks correct to me for two repos. It's possible that Borg/borgmatic just haven't finished running though, and therefore the logs aren't yet complete.

Everything there looks correct to me for two repos. It's possible that Borg/borgmatic just haven't finished running though, and therefore the logs aren't yet complete.
Author

You are right

Apr 18 00:08:54 host borgmatic: INFO Remote: packet_write_wait: Connection to 95.216.116.248 port 22: Broken pipe
Apr 18 00:08:54 host borgmatic: INFO RemoteRepository: 471 B bytes sent, 138.85 kB bytes received, 10 messages sent
Apr 18 00:08:54 host borgmatic: INFO Connection closed by remote host
Apr 18 00:08:54 host borgmatic: INFO Traceback (most recent call last):
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 154, in wrapper
Apr 18 00:08:54 host borgmatic: INFO     return method(self, args, repository=repository, **kwargs)
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 1592, in do_prune
Apr 18 00:08:54 host borgmatic: INFO     Archive(repository, key, manifest, archive.name, cache).delete(stats, forced=args.forced)
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/archive.py", line 804, in delete
Apr 18 00:08:54 host borgmatic: INFO     for (i, (items_id, data)) in enumerate(zip(items_ids, self.repository.get_many(items_ids))):
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/remote.py", line 938, in get_many
Apr 18 00:08:54 host borgmatic: INFO     for resp in self.call_many('get', [{'id': id} for id in ids], is_preloaded=is_preloaded):
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/remote.py", line 815, in call_many
Apr 18 00:08:54 host borgmatic: INFO     raise ConnectionClosed()
Apr 18 00:08:54 host borgmatic: INFO borg.remote.ConnectionClosed: Connection closed by remote host
Apr 18 00:08:54 host borgmatic: INFO During handling of the above exception, another exception occurred:
Apr 18 00:08:54 host borgmatic: INFO Traceback (most recent call last):
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4455, in main
Apr 18 00:08:54 host borgmatic: INFO     exit_code = archiver.run(args)
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4387, in run
Apr 18 00:08:54 host borgmatic: INFO     return set_ec(func(args))
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/archiver.py", line 154, in wrapper
Apr 18 00:08:54 host borgmatic: INFO     return method(self, args, repository=repository, **kwargs)
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/remote.py", line 635, in __exit__
Apr 18 00:08:54 host borgmatic: INFO     self.rollback()
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/remote.py", line 478, in do_rpc
Apr 18 00:08:54 host borgmatic: INFO     return self.call(f.__name__, named, **extra)
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/remote.py", line 713, in call
Apr 18 00:08:54 host borgmatic: INFO     for resp in self.call_many(cmd, [args], **kw):
Apr 18 00:08:54 host borgmatic: INFO   File "/usr/lib/python3/dist-packages/borg/remote.py", line 815, in call_many
Apr 18 00:08:54 host borgmatic: INFO     raise ConnectionClosed()
Apr 18 00:08:54 host borgmatic: INFO borg.remote.ConnectionClosed: Connection closed by remote host
Apr 18 00:08:54 host borgmatic: INFO Platform: Linux host.ocurre.io 4.19.0-20-amd64 #1 SMP Debian 4.19.235-1 (2022-03-17) x86_64
Apr 18 00:08:54 host borgmatic: INFO Linux: debian 10.12
Apr 18 00:08:54 host borgmatic: INFO Borg: 1.1.9  Python: CPython 3.7.3
Apr 18 00:08:54 host borgmatic: INFO PID: 27026  CWD: /root
Apr 18 00:08:54 host borgmatic: INFO sys.argv: ['/usr/bin/borg', 'prune', '--keep-daily', '2', '--keep-weekly', '4', '--keep-monthly', '12', '--keep-yearly', '2', '--prefix', '{hostname}-', '--debug', '--show-rc', 'q4nudxni@q4nudxni.repo.server.tld:repo']
Apr 18 00:08:54 host borgmatic: INFO SSH_ORIGINAL_COMMAND: None
Apr 18 00:08:54 host borgmatic: INFO terminating with error status, rc 2
Apr 18 00:08:54 host borgmatic: CRITICAL q4nudxni@q4nudxni.repo.server.tld:repo: Error running actions for repository
Apr 18 00:08:54 host borgmatic: CRITICAL Command 'borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- --debug --show-rc q4nudxni@q4nudxni.repo.server.tld:repo' returned non-zero exit status 2.
Apr 18 00:08:54 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for on-error hook
Apr 18 00:08:54 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Calling healthchecks hook function ping_monitor
Apr 18 00:08:54 host borgmatic: INFO /etc/borgmatic/config.yaml: Pinging Healthchecks fail
Apr 18 00:08:54 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Using Healthchecks ping URL https://hc-ping.com/1ad37d58-0f57-42dc-bfef-a8db78e33539/fail
Apr 18 00:08:55 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Calling healthchecks hook function destroy_monitor
Apr 18 00:08:55 host borgmatic: CRITICAL /etc/borgmatic/config.yaml: Error running configuration file
Apr 18 00:08:55 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for post-everything hook
Apr 18 00:08:55 host borgmatic: CRITICAL 
Apr 18 00:08:55 host borgmatic: CRITICAL summary:
Apr 18 00:08:55 host borgmatic: CRITICAL /etc/borgmatic/config.yaml: Error running configuration file
Apr 18 00:08:55 host borgmatic: CRITICAL q4nudxni@q4nudxni.repo.server.tld:repo: Error running actions for repository
Apr 18 00:08:55 host borgmatic: CRITICAL ...#012borg.remote.ConnectionClosed: Connection closed by remote host#012During handling of the above exception, another exception occurred:#012Traceback (most recent call last):#012  File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4455, in main#012    exit_code = archiver.run(args)#012  File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4387, in run#012    return set_ec(func(args))#012  File "/usr/lib/python3/dist-packages/borg/archiver.py", line 154, in wrapper#012    return method(self, args, repository=repository, **kwargs)#012  File "/usr/lib/python3/dist-packages/borg/remote.py", line 635, in __exit__#012    self.rollback()#012  File "/usr/lib/python3/dist-packages/borg/remote.py", line 478, in do_rpc#012    return self.call(f.__name__, named, **extra)#012  File "/usr/lib/python3/dist-packages/borg/remote.py", line 713, in call#012    for resp in self.call_many(cmd, [args], **kw):#012  File "/usr/lib/python3/dist-packages/borg/remote.py", line 815, in call_many#012    raise ConnectionClosed()#012borg.remote.ConnectionClosed: Connection closed by remote host#012Platform: Linux host.ocurre.io 4.19.0-20-amd64 #1 SMP Debian 4.19.235-1 (2022-03-17) x86_64#012Linux: debian 10.12#012Borg: 1.1.9  Python: CPython 3.7.3#012PID: 27026  CWD: /root#012sys.argv: ['/usr/bin/borg', 'prune', '--keep-daily', '2', '--keep-weekly', '4', '--keep-monthly', '12', '--keep-yearly', '2', '--prefix', '{hostname}-', '--debug', '--show-rc', 'q4nudxni@q4nudxni.repo.server.tld:repo']#012SSH_ORIGINAL_COMMAND: None#012terminating with error status, rc 2
Apr 18 00:08:55 host borgmatic: CRITICAL Command 'borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- --debug --show-rc q4nudxni@q4nudxni.repo.server.tld:repo' returned non-zero exit status 2.
Apr 18 00:08:55 host borgmatic: CRITICAL 
Apr 18 00:08:55 host borgmatic: CRITICAL Need some help? https://torsion.org/borgmatic/#issues
You are right ``` Apr 18 00:08:54 host borgmatic: INFO Remote: packet_write_wait: Connection to 95.216.116.248 port 22: Broken pipe Apr 18 00:08:54 host borgmatic: INFO RemoteRepository: 471 B bytes sent, 138.85 kB bytes received, 10 messages sent Apr 18 00:08:54 host borgmatic: INFO Connection closed by remote host Apr 18 00:08:54 host borgmatic: INFO Traceback (most recent call last): Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/archiver.py", line 154, in wrapper Apr 18 00:08:54 host borgmatic: INFO return method(self, args, repository=repository, **kwargs) Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/archiver.py", line 1592, in do_prune Apr 18 00:08:54 host borgmatic: INFO Archive(repository, key, manifest, archive.name, cache).delete(stats, forced=args.forced) Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/archive.py", line 804, in delete Apr 18 00:08:54 host borgmatic: INFO for (i, (items_id, data)) in enumerate(zip(items_ids, self.repository.get_many(items_ids))): Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/remote.py", line 938, in get_many Apr 18 00:08:54 host borgmatic: INFO for resp in self.call_many('get', [{'id': id} for id in ids], is_preloaded=is_preloaded): Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/remote.py", line 815, in call_many Apr 18 00:08:54 host borgmatic: INFO raise ConnectionClosed() Apr 18 00:08:54 host borgmatic: INFO borg.remote.ConnectionClosed: Connection closed by remote host Apr 18 00:08:54 host borgmatic: INFO During handling of the above exception, another exception occurred: Apr 18 00:08:54 host borgmatic: INFO Traceback (most recent call last): Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4455, in main Apr 18 00:08:54 host borgmatic: INFO exit_code = archiver.run(args) Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4387, in run Apr 18 00:08:54 host borgmatic: INFO return set_ec(func(args)) Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/archiver.py", line 154, in wrapper Apr 18 00:08:54 host borgmatic: INFO return method(self, args, repository=repository, **kwargs) Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/remote.py", line 635, in __exit__ Apr 18 00:08:54 host borgmatic: INFO self.rollback() Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/remote.py", line 478, in do_rpc Apr 18 00:08:54 host borgmatic: INFO return self.call(f.__name__, named, **extra) Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/remote.py", line 713, in call Apr 18 00:08:54 host borgmatic: INFO for resp in self.call_many(cmd, [args], **kw): Apr 18 00:08:54 host borgmatic: INFO File "/usr/lib/python3/dist-packages/borg/remote.py", line 815, in call_many Apr 18 00:08:54 host borgmatic: INFO raise ConnectionClosed() Apr 18 00:08:54 host borgmatic: INFO borg.remote.ConnectionClosed: Connection closed by remote host Apr 18 00:08:54 host borgmatic: INFO Platform: Linux host.ocurre.io 4.19.0-20-amd64 #1 SMP Debian 4.19.235-1 (2022-03-17) x86_64 Apr 18 00:08:54 host borgmatic: INFO Linux: debian 10.12 Apr 18 00:08:54 host borgmatic: INFO Borg: 1.1.9 Python: CPython 3.7.3 Apr 18 00:08:54 host borgmatic: INFO PID: 27026 CWD: /root Apr 18 00:08:54 host borgmatic: INFO sys.argv: ['/usr/bin/borg', 'prune', '--keep-daily', '2', '--keep-weekly', '4', '--keep-monthly', '12', '--keep-yearly', '2', '--prefix', '{hostname}-', '--debug', '--show-rc', 'q4nudxni@q4nudxni.repo.server.tld:repo'] Apr 18 00:08:54 host borgmatic: INFO SSH_ORIGINAL_COMMAND: None Apr 18 00:08:54 host borgmatic: INFO terminating with error status, rc 2 Apr 18 00:08:54 host borgmatic: CRITICAL q4nudxni@q4nudxni.repo.server.tld:repo: Error running actions for repository Apr 18 00:08:54 host borgmatic: CRITICAL Command 'borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- --debug --show-rc q4nudxni@q4nudxni.repo.server.tld:repo' returned non-zero exit status 2. Apr 18 00:08:54 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for on-error hook Apr 18 00:08:54 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Calling healthchecks hook function ping_monitor Apr 18 00:08:54 host borgmatic: INFO /etc/borgmatic/config.yaml: Pinging Healthchecks fail Apr 18 00:08:54 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Using Healthchecks ping URL https://hc-ping.com/1ad37d58-0f57-42dc-bfef-a8db78e33539/fail Apr 18 00:08:55 host borgmatic: DEBUG /etc/borgmatic/config.yaml: Calling healthchecks hook function destroy_monitor Apr 18 00:08:55 host borgmatic: CRITICAL /etc/borgmatic/config.yaml: Error running configuration file Apr 18 00:08:55 host borgmatic: DEBUG /etc/borgmatic/config.yaml: No commands to run for post-everything hook Apr 18 00:08:55 host borgmatic: CRITICAL Apr 18 00:08:55 host borgmatic: CRITICAL summary: Apr 18 00:08:55 host borgmatic: CRITICAL /etc/borgmatic/config.yaml: Error running configuration file Apr 18 00:08:55 host borgmatic: CRITICAL q4nudxni@q4nudxni.repo.server.tld:repo: Error running actions for repository Apr 18 00:08:55 host borgmatic: CRITICAL ...#012borg.remote.ConnectionClosed: Connection closed by remote host#012During handling of the above exception, another exception occurred:#012Traceback (most recent call last):#012 File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4455, in main#012 exit_code = archiver.run(args)#012 File "/usr/lib/python3/dist-packages/borg/archiver.py", line 4387, in run#012 return set_ec(func(args))#012 File "/usr/lib/python3/dist-packages/borg/archiver.py", line 154, in wrapper#012 return method(self, args, repository=repository, **kwargs)#012 File "/usr/lib/python3/dist-packages/borg/remote.py", line 635, in __exit__#012 self.rollback()#012 File "/usr/lib/python3/dist-packages/borg/remote.py", line 478, in do_rpc#012 return self.call(f.__name__, named, **extra)#012 File "/usr/lib/python3/dist-packages/borg/remote.py", line 713, in call#012 for resp in self.call_many(cmd, [args], **kw):#012 File "/usr/lib/python3/dist-packages/borg/remote.py", line 815, in call_many#012 raise ConnectionClosed()#012borg.remote.ConnectionClosed: Connection closed by remote host#012Platform: Linux host.ocurre.io 4.19.0-20-amd64 #1 SMP Debian 4.19.235-1 (2022-03-17) x86_64#012Linux: debian 10.12#012Borg: 1.1.9 Python: CPython 3.7.3#012PID: 27026 CWD: /root#012sys.argv: ['/usr/bin/borg', 'prune', '--keep-daily', '2', '--keep-weekly', '4', '--keep-monthly', '12', '--keep-yearly', '2', '--prefix', '{hostname}-', '--debug', '--show-rc', 'q4nudxni@q4nudxni.repo.server.tld:repo']#012SSH_ORIGINAL_COMMAND: None#012terminating with error status, rc 2 Apr 18 00:08:55 host borgmatic: CRITICAL Command 'borg prune --keep-daily 2 --keep-weekly 4 --keep-monthly 12 --keep-yearly 2 --prefix {hostname}- --debug --show-rc q4nudxni@q4nudxni.repo.server.tld:repo' returned non-zero exit status 2. Apr 18 00:08:55 host borgmatic: CRITICAL Apr 18 00:08:55 host borgmatic: CRITICAL Need some help? https://torsion.org/borgmatic/#issues ```
Owner

That's looking like an error from Borg, specifically a problem with your network connection to the remote repository's server. You could try the work-around described here: https://torsion.org/borgmatic/docs/how-to/deal-with-very-large-backups/#broken-pipe-with-remote-repository

That's looking like an error from Borg, specifically a problem with your network connection to the remote repository's server. You could try the work-around described here: https://torsion.org/borgmatic/docs/how-to/deal-with-very-large-backups/#broken-pipe-with-remote-repository
Author

Thank you very much. I will try your suggestion. I wonder why this only happens with a single repository.

Thank you very much. I will try your suggestion. I wonder why this only happens with a single repository.
Owner

Could be a server with slower or less reliable connectivity?

Could be a server with slower or less reliable connectivity?
witten added the
waiting for response
label 2022-04-28 17:46:34 +00:00
Owner

I'm closing this for now, but if you have any follow-ups, please feel free to post them here! I'm happy to reopen if needed.

I'm closing this for now, but if you have any follow-ups, please feel free to post them here! I'm happy to reopen if needed.
witten removed the
waiting for response
label 2022-05-20 21:49:29 +00:00
Author

Thanks, @witten. You are right. It was the networking setup

Thanks, @witten. You are right. It was the networking setup
Owner

Awesome, I'm glad to hear it!

Awesome, I'm glad to hear it!
Sign in to join this conversation.
No Milestone
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: borgmatic-collective/borgmatic#519
No description provided.