Unable to execute Borgmatic when using pipx installation method #757

New Issue

Closed

opened 2023-09-17 21:56:41 +00:00 by tylerlucas · 8 comments

tylerlucas commented 2023-09-17 21:56:41 +00:00

Copy Link

What I'm trying to do and why

Issue

When installing using pipx, I'm unable to execute Borgmatic unless providing the full directory path

I'm following the instructions on this page.

Ubuntu 22.04LTS

Steps to reproduce

Troubleshooting/Repro

Prior to installing, I update my path with sudo pipx ensurepath:
/root/.local/bin has been been added to PATH, but you need to open a new terminal or re-login for this PATH change to take effect.

I have verified that my PATH does contain /root/.local/bin:
tyler@tl-pub-media:~$ echo $PATH /home/tyler/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/root/.local/bin

While installing, I receive this output:

tyler@tl-pub-media:~$ sudo pipx install borgmatic
[sudo] password for tyler:
  installed package borgmatic 1.8.2, installed using Python 3.10.12
  These apps are now globally available
    - borgmatic
    - generate-borgmatic-config
    - validate-borgmatic-config
⚠️  Note: '/root/.local/bin' is not on your PATH environment variable. These apps will not be globally accessible until your PATH is updated. Run 'pipx
    ensurepath' to automatically add it, or manually modify your PATH in your shell's config file (i.e. ~/.bashrc).
done! ✨ 🌟 ✨

I can execute when providing the full path:

tyler@tl-pub-media:~$ sudo /root/.local/bin/borgmatic --version
1.8.2

I cannot execute when calling 'borgmatic':

tyler@tl-pub-media:~$ sudo borgmatic --version
sudo: borgmatic: command not found

### Actual behavior

_No response_

### Expected behavior

_No response_

### Other notes / implementation ideas

_No response_

### borgmatic version

1.8.2

### borgmatic installation method

pipx

### Borg version

1.2.0

### Python version

Python 3.10.12

### Database version (if applicable)

_No response_

### Operating system and version

Ubuntu 22.04.3

### What I'm trying to do and why # Issue When installing using pipx, I'm unable to execute Borgmatic unless providing the full directory path I'm following the instructions on [this page](https://torsion.org/borgmatic/docs/how-to/set-up-backups/). Ubuntu 22.04LTS ### Steps to reproduce # Troubleshooting/Repro Prior to installing, I update my path with `sudo pipx ensurepath`: `/root/.local/bin has been been added to PATH, but you need to open a new terminal or re-login for this PATH change to take effect.` I have verified that my PATH does contain `/root/.local/bin`: `tyler@tl-pub-media:~$ echo $PATH /home/tyler/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/root/.local/bin` While installing, I receive this output: ``` tyler@tl-pub-media:~$ sudo pipx install borgmatic [sudo] password for tyler: installed package borgmatic 1.8.2, installed using Python 3.10.12 These apps are now globally available - borgmatic - generate-borgmatic-config - validate-borgmatic-config ⚠️ Note: '/root/.local/bin' is not on your PATH environment variable. These apps will not be globally accessible until your PATH is updated. Run 'pipx ensurepath' to automatically add it, or manually modify your PATH in your shell's config file (i.e. ~/.bashrc). done! ✨ 🌟 ✨ ``` I can execute when providing the full path: ``` tyler@tl-pub-media:~$ sudo /root/.local/bin/borgmatic --version 1.8.2 ``` I cannot execute when calling 'borgmatic': ``` tyler@tl-pub-media:~$ sudo borgmatic --version sudo: borgmatic: command not found ### Actual behavior _No response_ ### Expected behavior _No response_ ### Other notes / implementation ideas _No response_ ### borgmatic version 1.8.2 ### borgmatic installation method pipx ### Borg version 1.2.0 ### Python version Python 3.10.12 ### Database version (if applicable) _No response_ ### Operating system and version Ubuntu 22.04.3

tylerlucas changed title from Unable to execute Borgmatic when using pipx installation method to Unable to execute Borgmatic when using pipx installation method 2023-09-17 21:57:59 +00:00

witten commented 2023-09-18 01:36:05 +00:00

Owner

Copy Link

Thanks for filing this! I think you're running into this problem because pipx ensurepath only applies to the shell for the Unix user account in which that command is run. In other words, when you run sudo pipx ensurepath, that modifies the PATH environment variable for the root user—but not for your non-root user. So I see a couple of options here:

• You can su or sudo to a root shell before running borgmatic as the root user. That should work because it'll use root's PATH.
• Or: Manually add /root/.local/bin to your non-root user's PATH (in ~/.bashrc or similar) so sudo borgmatic works as expected.
• Or: Install borgmatic (and run pipx ensurepath) as a non-root user instead of (or in addition to) a root user. This would only work though if you want to run borgmatic as a non-root user and therefore only have access to that user's files.

I'll try to cover this use case a little better in the documentation.

Thanks for filing this! I think you're running into this problem because `pipx ensurepath` only applies to the shell for the Unix user account in which that command is run. In other words, when you run `sudo pipx ensurepath`, that modifies the `PATH` environment variable for the root user—but not for your non-root user. So I see a couple of options here: * You can `su` or `sudo` to a root shell before running borgmatic as the root user. That should work because it'll use root's `PATH`. * Or: Manually add `/root/.local/bin` to your non-root user's PATH (in `~/.bashrc` or similar) so `sudo borgmatic` works as expected. * Or: Install borgmatic (and run `pipx ensurepath`) as a non-root user instead of (or in addition to) a root user. This would only work though if you want to run borgmatic as a non-root user and therefore only have access to that user's files. I'll try to cover this use case a little better in the documentation.

witten referenced this issue from a commit 2023-09-18 05:46:52 +00:00

Updated documentation so "sudo borgmatic" works for pipx borgmatic installations (#757).

witten commented 2023-09-18 06:33:01 +00:00

Owner

Copy Link

Okay, I implemented some documentation updates that should hopefully clarify this situation. Please check it out and let me know what you think and whether this solves your issue at all: https://torsion.org/borgmatic/docs/how-to/set-up-backups/#installation

If not, I'd be happy to reopen this ticket and try something else. ("Happy" in that I'd be cursing the Python packaging ecosystem all the while.)

Okay, I implemented some documentation updates that should hopefully clarify this situation. Please check it out and let me know what you think and whether this solves your issue at all: https://torsion.org/borgmatic/docs/how-to/set-up-backups/#installation If not, I'd be happy to reopen this ticket and try something else. ("Happy" in that I'd be cursing the Python packaging ecosystem all the while.)

witten closed this issue 2023-09-18 06:33:01 +00:00

tylerlucas commented 2023-09-18 20:10:12 +00:00

Author

Copy Link

Thanks! Is there any risk if installing both root and non-root?

Thanks! Is there any risk if installing both root and non-root?

witten commented 2023-09-18 20:44:40 +00:00

Owner

Copy Link

The only risk I can think of is that you might upgrade one and forget to upgrade the other—and end up with different versions installed!

The only risk I can think of is that you might upgrade one and forget to upgrade the other—and end up with different versions installed!

y8s commented 2023-10-09 14:18:04 +00:00

Copy Link

After upgrading to bookworm and all my backups failing, I was getting the "module not found" error with borgmatic so I came to reinstall and see it's now via pipx instead of pip.

I tried the root install and the user install and adding the path to .bashrc, but neither option makes sudo borgmatic --version work.

I can do it with my user or as root but not with sudo:

user@pve:~ $ sudo borgmatic --version
sudo: borgmatic: command not found

user@pve:~ $ borgmatic --version
1.8.3

user@pve:~ $ sudo su -
root@pve:~ # borgmatic --version
1.8.3

halp?

After upgrading to bookworm and all my backups failing, I was getting the "module not found" error with borgmatic so I came to reinstall and see it's now via `pipx `instead of `pip`. I tried the root install and the user install and adding the path to `.bashrc`, but neither option makes `sudo borgmatic --version` work. I can do it with my user or as root but not with sudo: ``` user@pve:~ $ sudo borgmatic --version sudo: borgmatic: command not found user@pve:~ $ borgmatic --version 1.8.3 user@pve:~ $ sudo su - root@pve:~ # borgmatic --version 1.8.3 ``` halp?

witten commented 2023-10-09 16:39:07 +00:00

Owner

Copy Link

Hmm.. Some thoughts:

• How did you add the path to your .bashrc? Did you use pipx ensurepath to do it? You might give that a shot rather than manual path modifications.
• Does the sudo command work if you specify sudo -E? That would indicate there's an environment variable (e.g. PATH) not getting set properly upon sudo.

Hmm.. Some thoughts: * How did you add the path to your `.bashrc`? Did you use `pipx ensurepath` to do it? You might give that a shot rather than manual path modifications. * Does the `sudo` command work if you specify `sudo -E`? That would indicate there's an environment variable (e.g. `PATH`) not getting set properly upon `sudo`.

y8s commented 2023-10-09 18:17:58 +00:00

Copy Link

I used pipx ensurepath and it put export PATH="$PATH:/root/.local/bin" in my .bashrc

echo $PATH shows /root/.local/bin

sudo -E does not work.

upon googling, it looks like there's a secure_path that's managed with visudo. I added /root/.local/bin to the end of that list and now sudo borgmatic --version works.

I used `pipx ensurepath` and it put `export PATH="$PATH:/root/.local/bin"` in my `.bashrc` `echo $PATH` shows `/root/.local/bin` `sudo -E` does not work. upon googling, it looks like there's a `secure_path` that's managed with visudo. I added `/root/.local/bin` to the end of that list and now `sudo borgmatic --version` works.

witten commented 2023-10-09 21:08:08 +00:00

Owner

Copy Link

Nice detective work! I'm glad to hear that worked. I'll make a note in the docs about this solution. Thanks!

Nice detective work! I'm glad to hear that worked. I'll make a note in the docs about this solution. Thanks!

witten referenced this issue from a commit 2023-10-09 21:16:26 +00:00

Add documentation note about sudo and sudoers "secure_path" option (#757).

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

command-hook-steps

2.1.2

2.1.1

2.1.0

2.0.13

2.0.12

2.0.11

2.0.10

2.0.9

2.0.8

2.0.7

2.0.6

2.0.5

2.0.4

2.0.3

2.0.2

2.0.1

2.0.0

1.9.14

1.9.13

1.9.12

1.9.11

1.9.10

1.9.9

1.9.8

1.9.7

1.9.6

1.9.5

1.9.4

1.9.3

1.9.2

1.9.1

1.9.0

1.8.14

1.8.13

1.8.12

1.8.11

1.8.10

1.8.9

1.8.8

1.8.7

1.8.6

1.8.5

1.8.4

1.8.3

1.8.2

1.8.1

1.8.0

1.7.15

1.7.14

1.7.13

1.7.12

1.7.11

1.7.10

1.7.9

1.7.8

1.7.7

1.7.6

1.7.5

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.7.dev0

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.26

1.3.25

1.3.24

1.3.23

1.3.22

1.3.21

1.3.20

1.3.19

1.3.18

1.3.17

1.3.16

1.3.15

1.3.14

1.3.13

1.3.12

1.3.11

1.3.10

1.3.9

1.3.8

1.3.7

1.3.6

1.3.5

1.3.4

1.3.3

1.3.2

1.3.1

1.3.0

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.15

1.1.14

1.1.13

1.1.12

1.1.11

1.1.10

1.1.9

1.1.7

1.1.6

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.3

1.0.2

1.0.1

1.0.0

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

Labels

Clear labels

blocked

breaking

bug

data loss

design finalized

good first issue

new feature area

question / support

security

waiting for response

No Label

Milestone

No items

No Milestone

Assignees

Clear assignees

witten

No Assignees

3 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: borgmatic-collective/borgmatic#757