--database does not find database dump when port is specified for database in config #1322

New issue

Closed

opened 2026-06-14 20:39:50 +00:00 by cegredev · 5 comments

cegredev commented 2026-06-14 20:39:50 +00:00

Copy link

What I'm trying to do and why

I'm trying to restore selected databases from my archives for the purpose of not having to restore all of them at once. This however results in an error saying the dumps don't exist: $PATH_TO_REPO: Cannot restore data source dump immich missing from archive. This error goes away when I don't specify the port in my borgmatic config (it's postgres default port 5432 but I like to be explicit).

Steps to reproduce

1. Setup a database using the following docker compose:

  db:
    image: postgres:18.4-alpine
    container_name: nextcloud_postgres
    volumes:
      - "../../storage/nextcloud/db:/var/lib/postgresql"
      - /run/user/1000:/run/user/1000 # I don't think I should need this, but it didn't work with or without it
    environment:
      - POSTGRES_DB=nextcloud
      - POSTGRES_USER=postgres
      - POSTGRES_PASSWORD=1234

2. Use something like the following borgmatic config. Use it in a test repo of yours, if you have that.

repositories:
    - path: $PATH_TO_REPO

source_directories:
    - ...

postgresql_databases:
    - name: "nextcloud"
    # - port: 5432

      pg_dump_command: docker exec nextcloud_postgres pg_dump -U postgres
      pg_restore_command: docker exec -i nextcloud_postgres pg_restore -U postgres
      psql_command: docker exec -i nextcloud_postgres psql -U postgres

3. Run borgmatic create --config path/to/this/config.yaml
4. Run borgmatic restore --archive latest --database nextcloud
5. Uncomment the port, repeat 3. and 4. and watch it fail

Actual behavior

When the port is specified, the restore fails with the following output:

/home/me/borgmatic-test/borgmatic.yaml: BORG_PASSPHRASE_FD=*** BORG_EXIT_CODES=*** borg --version --log-json --debug --show-rc
/home/me/borgmatic-test/borgmatic.yaml: Borg 1.4.2
/home/me/borgmatic-test/repo: Running actions for repository
/home/me/borgmatic-test/repo: Restoring data sources from archive latest
/home/me/borgmatic-test/repo: Using runtime directory /run/user/1000/borgmatic
/home/me/borgmatic-test/repo: Calling bootstrap hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Looking for bootstrap manifest files to remove in /run/user/1000/borgmatic/bootstrap
/home/me/borgmatic-test/repo: Calling btrfs hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Calling lvm hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Calling mariadb hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing MariaDB data source dumps
/home/me/borgmatic-test/repo: Calling mongodb hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing MongoDB data source dumps
/home/me/borgmatic-test/repo: Calling mysql hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing MySQL data source dumps
/home/me/borgmatic-test/repo: Calling postgresql hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing PostgreSQL data source dumps
/home/me/borgmatic-test/repo: Calling sqlite hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing SQLite data source dumps
/home/me/borgmatic-test/repo: Calling zfs hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: BORG_PASSPHRASE_FD=*** BORG_EXIT_CODES=*** borg list --log-json --glob-archives {hostname}-* --last 1 --json /home/me/borgmatic-test/repo
/home/me/borgmatic-test/repo: Latest archive is hp-envy-fedora-2026-06-14T22:32:02.528301 (9e65d6be08de337547ae7352da6d5a6f5d1ed0d4329b04d5891cf9afd23b9113)
/home/me/borgmatic-test/repo: BORG_PASSPHRASE_FD=*** BORG_EXIT_CODES=*** borg list --log-json --json-lines /home/me/borgmatic-test/repo::hp-envy-fedora-2026-06-14T22:32:02.528301 sh:borgmatic/*_databases/dumps.json sh:run/user/1000/borgmatic/*_databases/dumps.json
/home/me/borgmatic-test/repo: BORG_PASSPHRASE_FD=*** BORG_EXIT_CODES=*** borg extract --log-json --debug --list --show-rc --stdout /home/me/borgmatic-test/repo::hp-envy-fedora-2026-06-14T22:32:02.528301 borgmatic/postgresql_databases/dumps.json > -1
/home/me/borgmatic-test/repo: Collecting database dumps from archive data source dumps metadata files
/home/me/borgmatic-test/repo: Calling bootstrap hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Looking for bootstrap manifest files to remove in /run/user/1000/borgmatic/bootstrap
/home/me/borgmatic-test/repo: Calling btrfs hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Calling lvm hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Calling mariadb hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing MariaDB data source dumps
/home/me/borgmatic-test/repo: Calling mongodb hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing MongoDB data source dumps
/home/me/borgmatic-test/repo: Calling mysql hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing MySQL data source dumps
/home/me/borgmatic-test/repo: Calling postgresql hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing PostgreSQL data source dumps
/home/me/borgmatic-test/repo: Calling sqlite hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Removing SQLite data source dumps
/home/me/borgmatic-test/repo: Calling zfs hook function remove_data_source_dumps
/home/me/borgmatic-test/repo: Error running actions for repository
/home/me/borgmatic-test/repo: Cannot restore data source dump nextcloud missing from archive
/home/me/borgmatic-test/borgmatic.yaml: Error running configuration
/home/me/borgmatic-test/borgmatic.yaml: An error occurred

summary:
/home/me/borgmatic-test/borgmatic.yaml: Loading configuration file
An error occurred
Error running actions for repository
Cannot restore data source dump nextcloud missing from archive
Error running configuration

Need some help? https://torsion.org/borgmatic/#issues

Expected behavior

It works.

Other notes / implementation ideas

No response

borgmatic version

2.1.5

borgmatic installation method

Either pip or package, don't remember and can check later if needed

Borg version

1.4.2

Python version

3.13.7

Database version (if applicable)

18.4

Operating system and version

Fedora 42

### What I'm trying to do and why I'm trying to restore selected databases from my archives for the purpose of not having to restore all of them at once. This however results in an error saying the dumps don't exist: `$PATH_TO_REPO: Cannot restore data source dump immich missing from archive`. This error goes away when I don't specify the port in my borgmatic config (it's postgres default port 5432 but I like to be explicit). ### Steps to reproduce 1. Setup a database using the following docker compose: ```yaml db: image: postgres:18.4-alpine container_name: nextcloud_postgres volumes: - "../../storage/nextcloud/db:/var/lib/postgresql" - /run/user/1000:/run/user/1000 # I don't think I should need this, but it didn't work with or without it environment: - POSTGRES_DB=nextcloud - POSTGRES_USER=postgres - POSTGRES_PASSWORD=1234 ``` 2. Use something like the following borgmatic config. Use it in a test repo of yours, if you have that. ```yaml repositories: - path: $PATH_TO_REPO source_directories: - ... postgresql_databases: - name: "nextcloud" # - port: 5432 pg_dump_command: docker exec nextcloud_postgres pg_dump -U postgres pg_restore_command: docker exec -i nextcloud_postgres pg_restore -U postgres psql_command: docker exec -i nextcloud_postgres psql -U postgres ``` 3. Run `borgmatic create --config path/to/this/config.yaml` 4. Run `borgmatic restore --archive latest --database nextcloud` 5. Uncomment the port, repeat 3. and 4. and watch it fail ### Actual behavior When the port is specified, the `restore` fails with the following output: ``` /home/me/borgmatic-test/borgmatic.yaml: BORG_PASSPHRASE_FD=*** BORG_EXIT_CODES=*** borg --version --log-json --debug --show-rc /home/me/borgmatic-test/borgmatic.yaml: Borg 1.4.2 /home/me/borgmatic-test/repo: Running actions for repository /home/me/borgmatic-test/repo: Restoring data sources from archive latest /home/me/borgmatic-test/repo: Using runtime directory /run/user/1000/borgmatic /home/me/borgmatic-test/repo: Calling bootstrap hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Looking for bootstrap manifest files to remove in /run/user/1000/borgmatic/bootstrap /home/me/borgmatic-test/repo: Calling btrfs hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Calling lvm hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Calling mariadb hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing MariaDB data source dumps /home/me/borgmatic-test/repo: Calling mongodb hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing MongoDB data source dumps /home/me/borgmatic-test/repo: Calling mysql hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing MySQL data source dumps /home/me/borgmatic-test/repo: Calling postgresql hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing PostgreSQL data source dumps /home/me/borgmatic-test/repo: Calling sqlite hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing SQLite data source dumps /home/me/borgmatic-test/repo: Calling zfs hook function remove_data_source_dumps /home/me/borgmatic-test/repo: BORG_PASSPHRASE_FD=*** BORG_EXIT_CODES=*** borg list --log-json --glob-archives {hostname}-* --last 1 --json /home/me/borgmatic-test/repo /home/me/borgmatic-test/repo: Latest archive is hp-envy-fedora-2026-06-14T22:32:02.528301 (9e65d6be08de337547ae7352da6d5a6f5d1ed0d4329b04d5891cf9afd23b9113) /home/me/borgmatic-test/repo: BORG_PASSPHRASE_FD=*** BORG_EXIT_CODES=*** borg list --log-json --json-lines /home/me/borgmatic-test/repo::hp-envy-fedora-2026-06-14T22:32:02.528301 sh:borgmatic/*_databases/dumps.json sh:run/user/1000/borgmatic/*_databases/dumps.json /home/me/borgmatic-test/repo: BORG_PASSPHRASE_FD=*** BORG_EXIT_CODES=*** borg extract --log-json --debug --list --show-rc --stdout /home/me/borgmatic-test/repo::hp-envy-fedora-2026-06-14T22:32:02.528301 borgmatic/postgresql_databases/dumps.json > -1 /home/me/borgmatic-test/repo: Collecting database dumps from archive data source dumps metadata files /home/me/borgmatic-test/repo: Calling bootstrap hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Looking for bootstrap manifest files to remove in /run/user/1000/borgmatic/bootstrap /home/me/borgmatic-test/repo: Calling btrfs hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Calling lvm hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Calling mariadb hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing MariaDB data source dumps /home/me/borgmatic-test/repo: Calling mongodb hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing MongoDB data source dumps /home/me/borgmatic-test/repo: Calling mysql hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing MySQL data source dumps /home/me/borgmatic-test/repo: Calling postgresql hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing PostgreSQL data source dumps /home/me/borgmatic-test/repo: Calling sqlite hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Removing SQLite data source dumps /home/me/borgmatic-test/repo: Calling zfs hook function remove_data_source_dumps /home/me/borgmatic-test/repo: Error running actions for repository /home/me/borgmatic-test/repo: Cannot restore data source dump nextcloud missing from archive /home/me/borgmatic-test/borgmatic.yaml: Error running configuration /home/me/borgmatic-test/borgmatic.yaml: An error occurred summary: /home/me/borgmatic-test/borgmatic.yaml: Loading configuration file An error occurred Error running actions for repository Cannot restore data source dump nextcloud missing from archive Error running configuration Need some help? https://torsion.org/borgmatic/#issues ``` ### Expected behavior It works. ### Other notes / implementation ideas _No response_ ### borgmatic version 2.1.5 ### borgmatic installation method Either pip or package, don't remember and can check later if needed ### Borg version 1.4.2 ### Python version 3.13.7 ### Database version (if applicable) 18.4 ### Operating system and version Fedora 42

witten added the

bug

label 2026-06-15 18:25:24 +00:00

witten referenced this issue from a commit 2026-06-15 18:56:21 +00:00

Fix for the "restore" action sometimes failing to find a database dump that was dumped with a default port (#1322).

witten commented 2026-06-15 18:58:46 +00:00

Owner

Copy link

Thanks for filing this! It's fixed in main and will be part of the next release. I also fixed the case of the reverse—starting with an explicit default port in config, dumping, and then removing the port from the config and doing a restore.

Note that I only bothered to fix this when using Borg 1.4+. Should be fine for your case, but I'm calling this out in case anyone else stumbles across the issue. If using Borg 1.2... upgrade!

Thanks for filing this! It's fixed in main and will be part of the next release. I also fixed the case of the reverse—starting with an explicit default port in config, dumping, and then removing the port from the config and doing a restore. Note that I only bothered to fix this when using Borg 1.4+. Should be fine for your case, but I'm calling this out in case anyone else stumbles across the issue. If using Borg 1.2... upgrade!

witten closed this issue 2026-06-15 18:58:46 +00:00

witten commented 2026-06-15 19:00:30 +00:00

Owner

Copy link

Ah, looks like I only fixed this when not using the --database flag. I'm gonna have to fix it a little harder...

Ah, looks like I only fixed this when not using the `--database` flag. I'm gonna have to fix it a little harder...

witten reopened this issue 2026-06-15 19:00:30 +00:00

witten commented 2026-06-15 19:05:53 +00:00

Owner

Copy link

Oh I lied; that case actually works as well! I just had a typo on my command-line. Calling this done again.

Oh I lied; that case actually works as well! I just had a typo on my command-line. Calling this done again.

❤️ 1

witten closed this issue 2026-06-15 19:05:54 +00:00

cegredev commented 2026-06-15 20:39:20 +00:00

Author

Copy link

Thank you!

Thank you!

👍 1

witten commented 2026-08-14 20:18:09 +00:00

Owner

Copy link

Released in borgmatic 2.1.7!

Released in borgmatic 2.1.7!

Sign in to join this conversation.

No Branch/Tag specified

Branches Tags

main

parallel-borgmatic

command-hook-steps

2.1.7

2.1.6

2.1.5

2.1.4

2.1.3

2.1.2

2.1.1

2.1.0

2.0.13

2.0.12

2.0.11

2.0.10

2.0.9

2.0.8

2.0.7

2.0.6

2.0.5

2.0.4

2.0.3

2.0.2

2.0.1

2.0.0

1.9.14

1.9.13

1.9.12

1.9.11

1.9.10

1.9.9

1.9.8

1.9.7

1.9.6

1.9.5

1.9.4

1.9.3

1.9.2

1.9.1

1.9.0

1.8.14

1.8.13

1.8.12

1.8.11

1.8.10

1.8.9

1.8.8

1.8.7

1.8.6

1.8.5

1.8.4

1.8.3

1.8.2

1.8.1

1.8.0

1.7.15

1.7.14

1.7.13

1.7.12

1.7.11

1.7.10

1.7.9

1.7.8

1.7.7

1.7.6

1.7.5

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.7.dev0

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.26

1.3.25

1.3.24

1.3.23

1.3.22

1.3.21

1.3.20

1.3.19

1.3.18

1.3.17

1.3.16

1.3.15

1.3.14

1.3.13

1.3.12

1.3.11

1.3.10

1.3.9

1.3.8

1.3.7

1.3.6

1.3.5

1.3.4

1.3.3

1.3.2

1.3.1

1.3.0

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.15

1.1.14

1.1.13

1.1.12

1.1.11

1.1.10

1.1.9

1.1.7

1.1.6

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.3

1.0.2

1.0.1

1.0.0

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

Labels

Clear labels   

blocked

  

breaking

  

bug

  

data loss

  

design finalized

  

good first issue

  

new feature area

  

question / support

  

security

  

waiting for response

No labels

blocked

breaking

bug

data loss

design finalized

good first issue

new feature area

question / support

security

waiting for response

Milestone

Clear milestone

No items

No milestone

Assignees

Clear assignees

No assignees

2 participants

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

borgmatic-collective/borgmatic#1322

No description provided.