borgmatic-collective/borgmatic
borgmatic-collective
/
borgmatic
15
56
Fork 39
Code Issues 52 Pull Requests 1 Actions Packages Releases 121 Activity

missing external drive at borgmatic create stops backup (borg create continues) #343

New Issue
Closed
opened 2020-07-26 13:20:05 +00:00 by adrinia · 2 comments
adrinia commented 2020-07-26 13:20:05 +00:00
Copy Link

What I'm trying to do and why

Make a backup process that includes directories on an external drive when present and just skips these directories when the drive is not mounted. If the external drive is not mounted the procedure should just skip those dirs and continue, like when i call borg create under the same circumstances.

Steps to reproduce (if a bug)

location:
source_directories:
- /Users/anders/Documents/
- /Volumes/klumpen3/dokument/

one_file_system: true

repositories:
    - AAAAAAAA@AAAAAAAA.repo.borgbase.com:repo

exclude_if_present: .nobackup

storage:
encryption_passphrase: "AAAAAAAA"

compression: lz4

umask: 0077

lock_wait: 5

archive_name_format: '{hostname}-documents-{now}'

retention:
keep_within: 3H

keep_minutely: 60

keep_hourly: 24

keep_daily: 7

keep_weekly: 4

keep_monthly: 6

keep_yearly: 1

prefix: sourcehostname

consistency:
checks:
- repository
- archives

check_last: 3

Actual behavior (if a bug)

Ensuring legacy configuration is upgraded
/Users/anders/.config/borgmatic/config.yaml: No commands to run for pre-everything hook
/Users/anders/.config/borgmatic/config.yaml: No commands to run for pre-backup hook
ncok21b1@ncok21b1.repo.borgbase.com:repo: Creating archive
ncok21b1@ncok21b1.repo.borgbase.com:repo: Error running actions for repository
[Errno 2] No such file or directory: '/Volumes/klumpen3/dokument/'
/Users/anders/.config/borgmatic/config.yaml: No commands to run for on-error hook
/Users/anders/.config/borgmatic/config.yaml: Error running configuration file
/Users/anders/.config/borgmatic/config.yaml: No commands to run for post-everything hook

summary:
/Users/anders/.config/borgmatic/config.yaml: Error running configuration file
ncok21b1@ncok21b1.repo.borgbase.com:repo: Error running actions for repository
[Errno 2] No such file or directory: '/Volumes/klumpen3/dokument/'

Need some help? https://torsion.org/borgmatic/#issues

Expected behavior (if a bug)

I would like borgmatic to still create the archive even at times when some directories are missing. Like when I do the borg create, this is the output I get

Creating archive at "AAAAAAA@AAAAAAA.repo.borgbase.com:repo::AAAAAAA-2020-07-26T15:15:13"
/Volumes/klumpen3/dokument: [Errno 2] No such file or directory: '/Volumes/klumpen3/dokument'
Remote: Storage quota: 422.74 GB out of 4.00 TB used.
Remote: Storage quota: 422.74 GB out of 4.00 TB used.

But the archive named AAAAAAA-2020-07-26T15:15:13 is still created. When borgmatic is run, the archive is not created.

Other notes / implementation ideas

Environment

borgmatic version: 1.5.9

borgmatic installation method: brew install borgmatic

Borg version: Borg 1.1.11

Python version: Python 3.7.0

operating system and version: MacOS Catalina 10.15.6

#### What I'm trying to do and why Make a backup process that includes directories on an external drive when present and just skips these directories when the drive is not mounted. If the external drive is not mounted the procedure should just skip those dirs and continue, like when i call borg create under the same circumstances. #### Steps to reproduce (if a bug) location: source_directories: - /Users/anders/Documents/ - /Volumes/klumpen3/dokument/ one_file_system: true repositories: - AAAAAAAA@AAAAAAAA.repo.borgbase.com:repo exclude_if_present: .nobackup storage: encryption_passphrase: "AAAAAAAA" compression: lz4 umask: 0077 lock_wait: 5 archive_name_format: '{hostname}-documents-{now}' retention: keep_within: 3H keep_minutely: 60 keep_hourly: 24 keep_daily: 7 keep_weekly: 4 keep_monthly: 6 keep_yearly: 1 prefix: sourcehostname consistency: checks: - repository - archives check_last: 3 #### Actual behavior (if a bug) Ensuring legacy configuration is upgraded /Users/anders/.config/borgmatic/config.yaml: No commands to run for pre-everything hook /Users/anders/.config/borgmatic/config.yaml: No commands to run for pre-backup hook ncok21b1@ncok21b1.repo.borgbase.com:repo: Creating archive ncok21b1@ncok21b1.repo.borgbase.com:repo: Error running actions for repository [Errno 2] No such file or directory: '/Volumes/klumpen3/dokument/' /Users/anders/.config/borgmatic/config.yaml: No commands to run for on-error hook /Users/anders/.config/borgmatic/config.yaml: Error running configuration file /Users/anders/.config/borgmatic/config.yaml: No commands to run for post-everything hook summary: /Users/anders/.config/borgmatic/config.yaml: Error running configuration file ncok21b1@ncok21b1.repo.borgbase.com:repo: Error running actions for repository [Errno 2] No such file or directory: '/Volumes/klumpen3/dokument/' Need some help? https://torsion.org/borgmatic/#issues #### Expected behavior (if a bug) I would like borgmatic to still create the archive even at times when some directories are missing. Like when I do the borg create, this is the output I get Creating archive at "AAAAAAA@AAAAAAA.repo.borgbase.com:repo::AAAAAAA-2020-07-26T15:15:13" /Volumes/klumpen3/dokument: [Errno 2] No such file or directory: '/Volumes/klumpen3/dokument' Remote: Storage quota: 422.74 GB out of 4.00 TB used. Remote: Storage quota: 422.74 GB out of 4.00 TB used. But the archive named AAAAAAA-2020-07-26T15:15:13 is still created. When borgmatic is run, the archive is not created. #### Other notes / implementation ideas #### Environment **borgmatic version:** 1.5.9 **borgmatic installation method:** brew install borgmatic **Borg version:** Borg 1.1.11 **Python version:** Python 3.7.0 **operating system and version:** MacOS Catalina 10.15.6
adrinia changed title from missing external drive at borgmatic create yields error (borg create yields warning) to missing external drive at borgmatic create stops backup (borg create continues) 2020-07-26 13:20:30 +00:00
adrinia commented 2020-07-26 13:55:35 +00:00
Author
Copy Link

I've found this
https://torsion.org/borgmatic/docs/how-to/backup-to-a-removable-drive-or-an-intermittent-server/

It seems like this solves my problem, should have read that before posting. I don't know how to delete this issue.

I've found this https://torsion.org/borgmatic/docs/how-to/backup-to-a-removable-drive-or-an-intermittent-server/ It seems like this solves my problem, should have read that before posting. I don't know how to delete this issue.
witten commented 2020-07-27 03:35:06 +00:00
Owner
Copy Link

I'm glad to hear that the soft failure feature might solve your problem! If it turns out that it does not, please do let me know.

I'll go ahead and close this issue.

I'm glad to hear that the soft failure feature might solve your problem! If it turns out that it does not, please do let me know. I'll go ahead and close this issue.
witten added the
question / support
 label 2020-07-27 03:35:22 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
main
spot-check
1.8.10
1.8.9
1.8.8
1.8.7
1.8.6
1.8.5
1.8.4
1.8.3
1.8.2
1.8.1
1.8.0
1.7.15
1.7.14
1.7.13
1.7.12
1.7.11
1.7.10
1.7.9
1.7.8
1.7.7
1.7.6
1.7.5
1.7.4
1.7.3
1.7.2
1.7.1
1.7.0
1.6.6
1.6.5
1.6.4
1.6.3
1.6.2
1.6.1
1.6.0
1.5.24
1.5.23
1.5.22
1.5.21
1.5.20
1.5.19
1.5.18
1.5.17
1.5.16
1.5.15
1.5.14
1.5.13
1.5.12
1.5.11
1.5.10
1.5.9
1.5.8
1.5.7
1.5.7.dev0
1.5.6
1.5.5
1.5.4
1.5.3
1.5.2
1.5.1
1.5.0
1.4.22
1.4.21
1.4.20
1.4.19
1.4.18
1.4.17
1.4.16
1.4.15
1.4.14
1.4.13
1.4.12
1.4.11
1.4.10
1.4.9
1.4.8
1.4.7
1.4.6
1.4.5
1.4.4
1.4.3
1.4.2
1.4.1
1.4.0
1.3.26
1.3.25
1.3.24
1.3.23
1.3.22
1.3.21
1.3.20
1.3.19
1.3.18
1.3.17
1.3.16
1.3.15
1.3.14
1.3.13
1.3.12
1.3.11
1.3.10
1.3.9
1.3.8
1.3.7
1.3.6
1.3.5
1.3.4
1.3.3
1.3.2
1.3.1
1.3.0
1.2.18
1.2.17
1.2.16
1.2.15
1.2.14
1.2.13
1.2.12
1.2.11
1.2.10
1.2.9
1.2.8
1.2.7
1.2.6
1.2.5
1.2.4
1.2.3
1.2.2
1.2.1
1.2.0
1.1.15
1.1.14
1.1.13
1.1.12
1.1.11
1.1.10
1.1.9
1.1.7
1.1.6
1.1.5
1.1.4
1.1.3
1.1.2
1.1.1
1.1.0
1.0.3
1.0.2
1.0.1
1.0.0
0.1.8
0.1.7
0.1.6
0.1.5
0.1.4
0.1.3
0.1.2
0.1.1
0.1.0
0.0.7
0.0.6
0.0.5
0.0.4
0.0.3
0.0.2
Labels
Clear labels   
bug

   
data loss

   
design finalized

   
good first issue

   
new feature area

   
question / support

   
security

   
waiting for response
No Label
bug
data loss
design finalized
good first issue
new feature area
question / support
security
waiting for response
Milestone
Clear milestone
No items
No Milestone
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: borgmatic-collective/borgmatic#343
No description provided.
Delete Branch "%!s(<nil>)"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?