borgmatic 1.7.13 fails to load config (?) #703

New Issue

Closed

opened 2023-05-28 07:51:52 +00:00 by agross · 3 comments

agross commented 2023-05-28 07:51:52 +00:00

Copy Link

What I'm trying to do and why

Steps to reproduce (if a bug)

$ borgmatic --version
1.7.13

agross@gateway-ogd ~
$ sudo borgmatic info
Traceback (most recent call last):
  File "/usr/bin/borgmatic", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/lib/python3.11/site-packages/borgmatic/commands/borgmatic.py", line 735, in main
    configs, parse_logs = load_configurations(
                          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/borgmatic/commands/borgmatic.py", line 508, in load_configurations
    config_filename, validate.schema_filename(), overrides, resolve_env
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/borgmatic/config/validate.py", line 23, in schema_filename
    return next(
               ^
TypeError: 'NoneType' object is not iterable

---
# Managed by Ansible, please don't edit manually

# Full config: https://torsion.org/borgmatic/docs/reference/config.yaml
location:
    source_directories:
        - /etc

    # Stay in same file system (do not cross mount points).
    one_file_system: True
    repositories:
        - ssh://example.com/volume2/NetBackup/borg/ogd/gateway

    # Store atime into archive.
    atime: False

    # Store ctime into archive.
    ctime: True


    # Exclude directories that contain a CACHEDIR.TAG file. See
    # http://www.brynosaurus.com/cachedir/spec.html for details.
    exclude_caches: true

    # Exclude directories that contain a file with the given filename.
    exclude_if_present: .nobackup

    # Alternate Borg remote executable. Defaults to "borg".
    # remote_path: borg1
    remote_path: /usr/local/bin/borg

# Repository storage options. See
# https://borgbackup.readthedocs.io/en/stable/usage.html#borg-create and
# https://borgbackup.readthedocs.io/en/stable/usage/general.html#environment-variables for
# details.
storage:
    encryption_passphrase: secret

    # The standard output of this command is used to unlock the encryption key. Only
    # use on repositories that were initialized with passcommand/repokey encryption.
    # Note that if both encryption_passcommand and encryption_passphrase are set,
    # then encryption_passphrase takes precedence.
    # encryption_passcommand: secret-tool lookup borg-repository repo-name

    # Type of compression to use when creating archives. See
    # https://borgbackup.readthedocs.org/en/stable/usage.html#borg-create for details.
    # Defaults to no compression.
    compression: auto,zstd

    # Remote network upload rate limit in kiBytes/second.

    # Command to use instead of just "ssh". This can be used to specify ssh options.
    # ssh_command: ssh -i ~/.ssh/id_ed25519
    ssh_command: ssh -o User=backup -i "/root/.ssh/borg-backup" -o StrictHostKeyChecking=accept-new

    # Umask to be used for borg create.
    umask: 0077

    # Maximum seconds to wait for acquiring a repository/cache lock.
    lock_wait: 5

    # Name of the archive. Borg placeholders can be used. See the output of
    # "borg help placeholders" for details. Default is
    # "{hostname}-{now:%Y-%m-%dT%H:%M:%S.%f}". If you specify this option, you must
    # also specify a prefix in the retention section to avoid accidental pruning of
    # archives with a different archive name format. And you should also specify a
    # prefix in the consistency section as well.
    archive_name_format: '{hostname}-system-{now}'
    match_archives: 'sh:{hostname}-system-*'

    # Bypass Borg error about a repository that has been moved.
    relocated_repo_access_is_ok: True

# Retention policy for how many backups to keep in each category. See
# https://borgbackup.readthedocs.org/en/stable/usage.html#borg-prune for details.
# At least one of the "keep" options is required for pruning to work.
retention:


    # Number of hourly archives to keep.
    keep_hourly: 3

    # Number of daily archives to keep.
    keep_daily: 7

    # Number of weekly archives to keep.
    keep_weekly: 4

    # Number of monthly archives to keep.
    keep_monthly: 6


# Consistency checks to run after backups. See
# https://borgbackup.readthedocs.org/en/stable/usage.html#borg-check and
# https://borgbackup.readthedocs.org/en/stable/usage.html#borg-extract for details.
consistency:
    # List of one or more consistency checks to run: "repository",
    # "archives", "data", and/or "extract". Defaults to
    # "repository" and "archives". Set to "disabled" to disable
    # all consistency checks. "repository" checks the consistency
    # of the repository, "archives" checks all of the archives,
    # "data" verifies the integrity of the data within the
    # archives, and "extract" does an extraction dry-run of the
    # most recent archive. Note that "data" implies "archives".
    checks:
        - {'name': 'repository', 'frequency': '4 weeks'}
        - {'name': 'archives', 'frequency': '6 weeks'}

    # Restrict the number of checked archives to the last n. Applies only to the "archives" check.
    check_last: 3

# Shell commands or scripts to execute before and after a backup or if an error has occurred.
# IMPORTANT: All provided commands and scripts are executed with user permissions of borgmatic.
# Do not forget to set secure permissions on this file as well as on any script listed (chmod 0700) to
# prevent potential shell injection or privilege escalation.
hooks:
    healthchecks:
        ping_url: https://healthchecks.io/ping/...

Environment

borgmatic version: 1.7.13

borgmatic installation method: dnf on Fedora

Borg version: borg 1.2.4

Python version: Python 3.11.3

operating system and version: Linux gateway 6.2.15-300.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 11 17:37:39 UTC 2023 x86_64 GNU/Linux

#### What I'm trying to do and why #### Steps to reproduce (if a bug) ```sh $ borgmatic --version 1.7.13 agross@gateway-ogd ~ $ sudo borgmatic info Traceback (most recent call last): File "/usr/bin/borgmatic", line 8, in <module> sys.exit(main()) ^^^^^^ File "/usr/lib/python3.11/site-packages/borgmatic/commands/borgmatic.py", line 735, in main configs, parse_logs = load_configurations( ^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/site-packages/borgmatic/commands/borgmatic.py", line 508, in load_configurations config_filename, validate.schema_filename(), overrides, resolve_env ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/site-packages/borgmatic/config/validate.py", line 23, in schema_filename return next( ^ TypeError: 'NoneType' object is not iterable ``` ```yaml --- # Managed by Ansible, please don't edit manually # Full config: https://torsion.org/borgmatic/docs/reference/config.yaml location: source_directories: - /etc # Stay in same file system (do not cross mount points). one_file_system: True repositories: - ssh://example.com/volume2/NetBackup/borg/ogd/gateway # Store atime into archive. atime: False # Store ctime into archive. ctime: True # Exclude directories that contain a CACHEDIR.TAG file. See # http://www.brynosaurus.com/cachedir/spec.html for details. exclude_caches: true # Exclude directories that contain a file with the given filename. exclude_if_present: .nobackup # Alternate Borg remote executable. Defaults to "borg". # remote_path: borg1 remote_path: /usr/local/bin/borg # Repository storage options. See # https://borgbackup.readthedocs.io/en/stable/usage.html#borg-create and # https://borgbackup.readthedocs.io/en/stable/usage/general.html#environment-variables for # details. storage: encryption_passphrase: secret # The standard output of this command is used to unlock the encryption key. Only # use on repositories that were initialized with passcommand/repokey encryption. # Note that if both encryption_passcommand and encryption_passphrase are set, # then encryption_passphrase takes precedence. # encryption_passcommand: secret-tool lookup borg-repository repo-name # Type of compression to use when creating archives. See # https://borgbackup.readthedocs.org/en/stable/usage.html#borg-create for details. # Defaults to no compression. compression: auto,zstd # Remote network upload rate limit in kiBytes/second. # Command to use instead of just "ssh". This can be used to specify ssh options. # ssh_command: ssh -i ~/.ssh/id_ed25519 ssh_command: ssh -o User=backup -i "/root/.ssh/borg-backup" -o StrictHostKeyChecking=accept-new # Umask to be used for borg create. umask: 0077 # Maximum seconds to wait for acquiring a repository/cache lock. lock_wait: 5 # Name of the archive. Borg placeholders can be used. See the output of # "borg help placeholders" for details. Default is # "{hostname}-{now:%Y-%m-%dT%H:%M:%S.%f}". If you specify this option, you must # also specify a prefix in the retention section to avoid accidental pruning of # archives with a different archive name format. And you should also specify a # prefix in the consistency section as well. archive_name_format: '{hostname}-system-{now}' match_archives: 'sh:{hostname}-system-*' # Bypass Borg error about a repository that has been moved. relocated_repo_access_is_ok: True # Retention policy for how many backups to keep in each category. See # https://borgbackup.readthedocs.org/en/stable/usage.html#borg-prune for details. # At least one of the "keep" options is required for pruning to work. retention: # Number of hourly archives to keep. keep_hourly: 3 # Number of daily archives to keep. keep_daily: 7 # Number of weekly archives to keep. keep_weekly: 4 # Number of monthly archives to keep. keep_monthly: 6 # Consistency checks to run after backups. See # https://borgbackup.readthedocs.org/en/stable/usage.html#borg-check and # https://borgbackup.readthedocs.org/en/stable/usage.html#borg-extract for details. consistency: # List of one or more consistency checks to run: "repository", # "archives", "data", and/or "extract". Defaults to # "repository" and "archives". Set to "disabled" to disable # all consistency checks. "repository" checks the consistency # of the repository, "archives" checks all of the archives, # "data" verifies the integrity of the data within the # archives, and "extract" does an extraction dry-run of the # most recent archive. Note that "data" implies "archives". checks: - {'name': 'repository', 'frequency': '4 weeks'} - {'name': 'archives', 'frequency': '6 weeks'} # Restrict the number of checked archives to the last n. Applies only to the "archives" check. check_last: 3 # Shell commands or scripts to execute before and after a backup or if an error has occurred. # IMPORTANT: All provided commands and scripts are executed with user permissions of borgmatic. # Do not forget to set secure permissions on this file as well as on any script listed (chmod 0700) to # prevent potential shell injection or privilege escalation. hooks: healthchecks: ping_url: https://healthchecks.io/ping/... ``` #### Environment **borgmatic version:** 1.7.13 **borgmatic installation method:** dnf on Fedora **Borg version:** borg 1.2.4 **Python version:** Python 3.11.3 **operating system and version:** Linux gateway 6.2.15-300.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu May 11 17:37:39 UTC 2023 x86_64 GNU/Linux

agross commented 2023-05-28 07:53:38 +00:00

Author

Copy Link

1.7.12 loads the config just fine

1.7.12 loads the config just fine

witten commented 2023-05-29 22:08:45 +00:00

Owner

Copy Link

Thanks for taking the time to file this and provide the details about your setup. I believe this may be a Fedora-specific issue that this in-progress pull request fixes: #702

I'll close this issue when it's resolved, and in the meantime I recommend you stick with 1.7.12.

Thanks for taking the time to file this and provide the details about your setup. I believe this may be a Fedora-specific issue that this in-progress pull request fixes: https://projects.torsion.org/borgmatic-collective/borgmatic/pulls/702 I'll close this issue when it's resolved, and in the meantime I recommend you stick with 1.7.12.

witten referenced this issue from a commit 2023-06-04 05:04:42 +00:00

Fix error loading configuration schema on Fedora Linux (#703).

witten referenced this issue from a commit 2023-06-04 05:08:44 +00:00

Add Fedora schema loading fix to NEWS (#703).

witten commented 2023-06-04 05:30:01 +00:00

Owner

Copy Link

The fix has just been released as part of borgmatic 1.7.14! Please let me know if you have any further problems around this.

The fix has just been released as part of borgmatic 1.7.14! Please let me know if you have any further problems around this.

witten closed this issue 2023-06-04 06:18:24 +00:00

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

2.0.5

2.0.4

2.0.3

2.0.2

2.0.1

2.0.0

1.9.14

1.9.13

1.9.12

1.9.11

1.9.10

1.9.9

1.9.8

1.9.7

1.9.6

1.9.5

1.9.4

1.9.3

1.9.2

1.9.1

1.9.0

1.8.14

1.8.13

1.8.12

1.8.11

1.8.10

1.8.9

1.8.8

1.8.7

1.8.6

1.8.5

1.8.4

1.8.3

1.8.2

1.8.1

1.8.0

1.7.15

1.7.14

1.7.13

1.7.12

1.7.11

1.7.10

1.7.9

1.7.8

1.7.7

1.7.6

1.7.5

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.7.dev0

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.26

1.3.25

1.3.24

1.3.23

1.3.22

1.3.21

1.3.20

1.3.19

1.3.18

1.3.17

1.3.16

1.3.15

1.3.14

1.3.13

1.3.12

1.3.11

1.3.10

1.3.9

1.3.8

1.3.7

1.3.6

1.3.5

1.3.4

1.3.3

1.3.2

1.3.1

1.3.0

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.15

1.1.14

1.1.13

1.1.12

1.1.11

1.1.10

1.1.9

1.1.7

1.1.6

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.3

1.0.2

1.0.1

1.0.0

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

Labels

Clear labels

blocked

bug

data loss

design finalized

good first issue

new feature area

question / support

security

waiting for response

No Label

Milestone

No items

No Milestone

Assignees

Clear assignees

diivi import_bot witten

No Assignees

2 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: borgmatic-collective/borgmatic#703

No description provided.