InfluxDB support #450

New Issue

Open

opened 2021-09-09 16:40:07 +00:00 by modem7 · 10 comments

modem7 commented 2021-09-09 16:40:07 +00:00

Copy Link

What I'm trying to do and why

Backup InfluxDB databases

Other notes / implementation ideas

Heya, would it be possible in future to maybe support InfluxDB as one of the databases supported for backup?

Environment

Docker, latest borgmatic version

#### What I'm trying to do and why Backup InfluxDB databases #### Other notes / implementation ideas Heya, would it be possible in future to maybe support InfluxDB as one of the databases supported for backup? #### Environment Docker, latest borgmatic version

witten commented 2021-09-09 16:47:10 +00:00

Owner

Copy Link

That would be cool! I haven't used InfluxDB though. Looks like influxd backup and influxd restore might be the way to do dump/restore from the command-line? Or maybe influx_inspect and influx -import?

That would be cool! I haven't used InfluxDB though. Looks like `influxd backup` and `influxd restore` might be the way to do dump/restore from the command-line? Or maybe `influx_inspect` and `influx -import`?

witten commented 2021-09-09 16:48:24 +00:00

Owner

Copy Link

I will also mention that you can use the borgmatic hooks feature to do dumps and restores "manually" even for databases that borgmatic doesn't support natively.

I will also mention that you can use the borgmatic hooks feature to do dumps and restores "manually" even for databases that borgmatic doesn't support natively.

modem7 commented 2021-09-09 16:49:38 +00:00

Author

Copy Link

Yupper!

My crappy script so far is as follows:

#Backup Varken Database
docker exec GrafanaDB influxd backup -since 2021-01-01T00:00:00Z -database varken /dbbackup/varken.bak
#Backup Telegraf Database
docker exec GrafanaDB influxd backup -since 2021-01-01T00:00:00Z -database telegraf /dbbackup/telegraf.bak

The "since" is something I'm still playing with.

The other option for a full backup is the "-portable" switch.

docker exec GrafanaDB influxd backup -portable /dbbackup/influxdb

This backs up all of the databases.

Yupper! My crappy script so far is as follows: ```bash #Backup Varken Database docker exec GrafanaDB influxd backup -since 2021-01-01T00:00:00Z -database varken /dbbackup/varken.bak #Backup Telegraf Database docker exec GrafanaDB influxd backup -since 2021-01-01T00:00:00Z -database telegraf /dbbackup/telegraf.bak ``` The "since" is something I'm still playing with. The other option for a full backup is the "-portable" switch. ```bash docker exec GrafanaDB influxd backup -portable /dbbackup/influxdb ``` This backs up all of the databases.

👍 1

s1shed commented 2021-09-09 19:04:10 +00:00

Contributor

Copy Link

For what it's worth I use hooks for backing up my influxdb databases.

hooks:
    # List of one or more shell commands or scripts to execute before creating a
    # backup, run once per configuration file.
    before_backup:
        - influxd backup -portable /root/influx-backup

    # List of one or more shell commands or scripts to execute after creating a
    # backup, run once per configuration file.
    after_backup:
        - rm -rf /root/influx-backup

For what it's worth I use hooks for backing up my influxdb databases. ```yaml hooks: # List of one or more shell commands or scripts to execute before creating a # backup, run once per configuration file. before_backup: - influxd backup -portable /root/influx-backup # List of one or more shell commands or scripts to execute after creating a # backup, run once per configuration file. after_backup: - rm -rf /root/influx-backup ```

👍 3

modem7 commented 2021-09-09 21:37:18 +00:00

Author

Copy Link

@s1shed - you've given me a great idea.

hooks:
    before_backup:
        - echo "Starting a backup job."
        - docker exec GrafanaDB influxd backup -portable /dbbackup/Influx.bak
        - exec /borgscripts/docker-stop.sh
    after_backup:
        - rm -rf /mnt/ramdrive/GrafanaInflux/*
        - exec /borgscripts/docker-start.sh
        - echo "Backup created."
    on_error:
        - echo "Error while creating a backup."
        - exec /borgscripts/docker-start.sh
    mysql_databases:
        - name: db
        - hostname: db
        - port: 3306
        - username: username
        - password: password

I've forked a version of b3vis's Borgmatic and included docker-cli in it so I can run Docker commands.

I've done some internal tests, and all seems good, but we'll see what happens tonight!

Thank you for the idea!

@s1shed - you've given me a great idea. ```yaml hooks: before_backup: - echo "Starting a backup job." - docker exec GrafanaDB influxd backup -portable /dbbackup/Influx.bak - exec /borgscripts/docker-stop.sh after_backup: - rm -rf /mnt/ramdrive/GrafanaInflux/* - exec /borgscripts/docker-start.sh - echo "Backup created." on_error: - echo "Error while creating a backup." - exec /borgscripts/docker-start.sh mysql_databases: - name: db - hostname: db - port: 3306 - username: username - password: password ``` I've [forked](https://hub.docker.com/repository/docker/modem7/borgmatic-docker) a version of b3vis's Borgmatic and included docker-cli in it so I can run Docker commands. I've done some internal tests, and all seems good, but we'll see what happens tonight! Thank you for the idea!

witten added the good first issue label 2023-02-04 17:44:16 +00:00

witten added the new feature area label 2023-06-28 18:42:26 +00:00

witten commented 2025-01-26 17:37:42 +00:00

Owner

Copy Link

Some movement on this! https://github.com/borgmatic-collective/borgmatic/pull/88

Some movement on this! https://github.com/borgmatic-collective/borgmatic/pull/88

❤️ 1

gautamaggarwal2810 commented 2025-03-30 17:30:39 +00:00

Contributor

Copy Link

I would like to work on this issue. What remains to be implemented and what should I do as I can see a PR already for this issue??

I would like to work on this issue. What remains to be implemented and what should I do as I can see a PR already for this issue??

witten commented 2025-03-31 18:32:51 +00:00

Owner

Copy Link

You might check in with KiaraGrouwstra on the PR to see if they plan on continuing it. If not, then you can either pick up where they left off on a new PR or start anew (potentially with that PR for inspiration). And please let me know if you have any questions along the way!

You might check in with KiaraGrouwstra on [the PR](https://github.com/borgmatic-collective/borgmatic/pull/88) to see if they plan on continuing it. If not, then you can either pick up where they left off on a new PR or start anew (potentially with that PR for inspiration). And please let me know if you have any questions along the way!

gautamaggarwal2810 commented 2025-04-02 12:31:46 +00:00

Contributor

Copy Link

@witten I checked with KiaraGrouwstra, and she has given me permission to take over this issue/PR. Her last update mentioned that the next step was running the tests, so I'll start from there because as far as I can see, she has made all changes asked by you in her code.

@witten I checked with KiaraGrouwstra, and she has given me permission to take over this issue/PR. Her last update mentioned that the next step was running the tests, so I'll start from there because as far as I can see, she has made all changes asked by you in her code.

witten commented 2025-04-02 18:30:41 +00:00

Owner

Copy Link

Great, thanks for checking. I haven't reviewed the most recent version of the code, but if it looks like a good starting place for you, then by all means use it!

Great, thanks for checking. I haven't reviewed the most recent version of the code, but if it looks like a good starting place for you, then by all means use it!

gautamaggarwal2810 referenced this issue 2025-04-07 07:24:17 +00:00

WIP : InfluxDB support #450 #1058

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

command-hook-steps

2.0.12

2.0.11

2.0.10

2.0.9

2.0.8

2.0.7

2.0.6

2.0.5

2.0.4

2.0.3

2.0.2

2.0.1

2.0.0

1.9.14

1.9.13

1.9.12

1.9.11

1.9.10

1.9.9

1.9.8

1.9.7

1.9.6

1.9.5

1.9.4

1.9.3

1.9.2

1.9.1

1.9.0

1.8.14

1.8.13

1.8.12

1.8.11

1.8.10

1.8.9

1.8.8

1.8.7

1.8.6

1.8.5

1.8.4

1.8.3

1.8.2

1.8.1

1.8.0

1.7.15

1.7.14

1.7.13

1.7.12

1.7.11

1.7.10

1.7.9

1.7.8

1.7.7

1.7.6

1.7.5

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.7.dev0

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.26

1.3.25

1.3.24

1.3.23

1.3.22

1.3.21

1.3.20

1.3.19

1.3.18

1.3.17

1.3.16

1.3.15

1.3.14

1.3.13

1.3.12

1.3.11

1.3.10

1.3.9

1.3.8

1.3.7

1.3.6

1.3.5

1.3.4

1.3.3

1.3.2

1.3.1

1.3.0

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.15

1.1.14

1.1.13

1.1.12

1.1.11

1.1.10

1.1.9

1.1.7

1.1.6

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.3

1.0.2

1.0.1

1.0.0

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

Labels

Clear labels

blocked

breaking

bug

data loss

design finalized

good first issue

new feature area

question / support

security

waiting for response

No Label good first issue new feature area

Milestone

No items

No Milestone

Assignees

Clear assignees

witten

No Assignees

4 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: borgmatic-collective/borgmatic#450