Failed backup with minimal error output #553

New Issue

Closed

opened 2022-06-28 18:39:25 +00:00 by pikeas · 4 comments

pikeas commented 2022-06-28 18:39:25 +00:00

Copy Link

What I'm trying to do and why

Run my first Borgmatic backup.

Steps to reproduce (if a bug)

$ borgmatic -v 2 --files
summary:
/Users/<user>/.config/borgmatic/config.yaml: Error running configuration file
ssh://<host>/./backups/<repo>: Error running actions for repository
...
A <file>
RemoteRepository: 154.15 MB bytes sent, 5.73 kB bytes received, 312 messages sent
Local Exception
Traceback (most recent call last):
Command 'borg create --exclude-from /var/folders/tk/<random id> --compression zstd,3 --list --filter AME- --debug --show-rc ssh://<host>/./backups/<repo>::{hostname}-{now:%Y-%m-%dT%H:%M:%S.%f} <folder>' returned non-zero exit status 2.

location:
    source_directories:
        - /Users/<user>
    repositories:
        - ssh://<host>/./backups/<repo>
    exclude_patterns:
        - junk
storage:
    encryption_passphrase: "<secret>"
    compression: zstd,3
retention:
    keep_daily: 7
    keep_weekly: 4
    keep_monthly: 12
    keep_yearly: 5

Actual behavior (if a bug)

See above, backup has failed with no specific error messages.

Expected behavior (if a bug)

Backup succeeds, or fails with additional output.

Environment

borgmatic version: 1.6.4
borgmatic installation method: pipx
Borg version: 1.2.1
Python version: 3.10.5
operating system and version: MacOS Monterey 12.3.1

#### What I'm trying to do and why Run my first Borgmatic backup. #### Steps to reproduce (if a bug) ``` $ borgmatic -v 2 --files summary: /Users/<user>/.config/borgmatic/config.yaml: Error running configuration file ssh://<host>/./backups/<repo>: Error running actions for repository ... A <file> RemoteRepository: 154.15 MB bytes sent, 5.73 kB bytes received, 312 messages sent Local Exception Traceback (most recent call last): Command 'borg create --exclude-from /var/folders/tk/<random id> --compression zstd,3 --list --filter AME- --debug --show-rc ssh://<host>/./backups/<repo>::{hostname}-{now:%Y-%m-%dT%H:%M:%S.%f} <folder>' returned non-zero exit status 2. ``` ``` location: source_directories: - /Users/<user> repositories: - ssh://<host>/./backups/<repo> exclude_patterns: - junk storage: encryption_passphrase: "<secret>" compression: zstd,3 retention: keep_daily: 7 keep_weekly: 4 keep_monthly: 12 keep_yearly: 5 ``` #### Actual behavior (if a bug) See above, backup has failed with no specific error messages. #### Expected behavior (if a bug) Backup succeeds, or fails with additional output. #### Environment **borgmatic version:** 1.6.4 **borgmatic installation method:** pipx **Borg version:** 1.2.1 **Python version:** 3.10.5 **operating system and version:** MacOS Monterey 12.3.1

witten commented 2022-06-28 19:57:27 +00:00

Owner

Copy Link

Thanks for taking the time to report this! It looks like Borg is experiencing an internal error and borgmatic is swallowing most of the traceback instead of forwarding it on to the user. I have come up with a local repro by forcing a Borg error, so I can look into why borgmatic is truncating the traceback.

In the meantime, you can run the Borg command directly to get the full Borg traceback:

borg create --exclude-from /var/folders/tk/<random id> --compression zstd,3 --list --filter AME- --debug --show-rc ssh://<host>/./backups/<repo>::{hostname}-{now:%Y-%m-%dT%H:%M:%S.%f} <folder>

... replacing <random id>, <host>, <repo>, and <folder>, of course.

Thanks for taking the time to report this! It looks like Borg is experiencing an internal error and borgmatic is swallowing most of the traceback instead of forwarding it on to the user. I have come up with a local repro by forcing a Borg error, so I can look into why borgmatic is truncating the traceback. In the meantime, you can run the Borg command directly to get the full Borg traceback: ```bash borg create --exclude-from /var/folders/tk/<random id> --compression zstd,3 --list --filter AME- --debug --show-rc ssh://<host>/./backups/<repo>::{hostname}-{now:%Y-%m-%dT%H:%M:%S.%f} <folder> ``` ... replacing `<random id>`, `<host>`, `<repo>`, and `<folder>`, of course.

witten added the

bug

label 2022-06-28 19:57:33 +00:00

witten referenced this issue from a commit 2022-06-28 20:38:55 +00:00

Fix logging to include the full traceback when Borg experiences an internal error (#553).

witten commented 2022-06-28 20:44:03 +00:00

Owner

Copy Link

Okay, this should be fixed in master—at least the borgmatic swallowing the Borg error part. The problem was that borgmatic stopped reading the Borg process output as soon as Borg exited with an error, leaving some of the traceback unread. There was code to account for this situation, but it wasn't doing its job and has been replaced.

The underlying Borg traceback is still probably present on your system, but it should hopefully be easier to debug now. Let me know if I can provide any help with it.

The fix will be part of the next borgmatic release. Thanks again for reporting it!

Okay, this should be fixed in master—at least the borgmatic swallowing the Borg error part. The problem was that borgmatic stopped reading the Borg process output as soon as Borg exited with an error, leaving some of the traceback unread. There *was* code to account for this situation, but it wasn't doing its job and has been replaced. The underlying Borg traceback is still probably present on your system, but it should hopefully be easier to debug now. Let me know if I can provide any help with it. The fix will be part of the next borgmatic release. Thanks again for reporting it!

witten closed this issue 2022-06-28 20:44:04 +00:00

pikeas commented 2022-06-28 20:55:31 +00:00

Author

Copy Link

Wow, fantastic response and phenomenal turnaround time, thank you!

Wow, fantastic response and phenomenal turnaround time, thank you!

👍 1

witten commented 2022-07-01 05:16:53 +00:00

Owner

Copy Link

Fix released in borgmatic 1.6.5!

Fix released in borgmatic 1.6.5!

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

2.0.4

2.0.3

2.0.2

2.0.1

2.0.0

1.9.14

1.9.13

1.9.12

1.9.11

1.9.10

1.9.9

1.9.8

1.9.7

1.9.6

1.9.5

1.9.4

1.9.3

1.9.2

1.9.1

1.9.0

1.8.14

1.8.13

1.8.12

1.8.11

1.8.10

1.8.9

1.8.8

1.8.7

1.8.6

1.8.5

1.8.4

1.8.3

1.8.2

1.8.1

1.8.0

1.7.15

1.7.14

1.7.13

1.7.12

1.7.11

1.7.10

1.7.9

1.7.8

1.7.7

1.7.6

1.7.5

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.7.dev0

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.26

1.3.25

1.3.24

1.3.23

1.3.22

1.3.21

1.3.20

1.3.19

1.3.18

1.3.17

1.3.16

1.3.15

1.3.14

1.3.13

1.3.12

1.3.11

1.3.10

1.3.9

1.3.8

1.3.7

1.3.6

1.3.5

1.3.4

1.3.3

1.3.2

1.3.1

1.3.0

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.15

1.1.14

1.1.13

1.1.12

1.1.11

1.1.10

1.1.9

1.1.7

1.1.6

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.3

1.0.2

1.0.1

1.0.0

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

Labels

Clear labels

blocked

bug

data loss

design finalized

good first issue

new feature area

question / support

security

waiting for response

No Label

bug

Milestone

No items

No Milestone

Assignees

Clear assignees

diivi import_bot witten

No Assignees

2 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: borgmatic-collective/borgmatic#553

No description provided.