Export elasticsearch data #499

New Issue

Closed

opened 2022-02-14 22:03:03 +00:00 by Firesphere · 4 comments

Firesphere commented 2022-02-14 22:03:03 +00:00

Copy Link

What I'm trying to do and why

I'd like Borgmatic to automatically export Elasticsearch data, same as MySQL/Postgres/MongoDB.

Other notes / implementation ideas

Environment

borgmatic version: Latest

borgmatic installation method: Doesn't matter

Borg version: Latest

Python version: 3.6+

Database version (if applicable): Elasticsearch 7.9.2 or higher

operating system and version: Ubuntu 18.04+/CentOS7

#### What I'm trying to do and why I'd like Borgmatic to automatically export Elasticsearch data, same as MySQL/Postgres/MongoDB. #### Other notes / implementation ideas #### Environment **borgmatic version:** Latest **borgmatic installation method:** Doesn't matter **Borg version:** Latest **Python version:** 3.6+ **Database version (if applicable):** Elasticsearch 7.9.2 or higher **operating system and version:** Ubuntu 18.04+/CentOS7

witten commented 2022-02-15 00:08:18 +00:00

Owner

Copy Link

Great idea! This might require installation of a third-party tool like elasticdump, since it doesn't sound like that functionality comes bundled with Elasticsearch. I guess there's also the option of using the Python Elasticsearch client directly.

Pull requests welcome! Anyone looking for ideas for where to start should check out the recent PR for adding MongoDB support.

Great idea! This might require installation of a third-party tool like [elasticdump](https://www.npmjs.com/package/elasticdump), since it doesn't sound like that functionality comes bundled with Elasticsearch. I guess there's also the option of using the [Python Elasticsearch client](https://elasticsearch-py.readthedocs.io/en/v8.0.0/) directly. Pull requests welcome! Anyone looking for ideas for where to start should check out [the recent PR for adding MongoDB support](https://projects.torsion.org/borgmatic-collective/borgmatic/pulls/483).

Firesphere commented 2022-04-19 09:35:59 +00:00

Author

Copy Link

Hi @witten ,

I've started, from the MongoDB example, working on Elastic export.
However, I'm not too familiar with the python --editable option for installing on a dev environment...

I'll keep my work on my fork, however much time I have to actually work on it.

I found Elastic Dump to be the easiest to use so far.

Hi @witten , I've started, from the MongoDB example, working on Elastic export. However, I'm not too familiar with the python `--editable` option for installing on a dev environment... I'll keep my work on my fork, however much time I have to actually work on it. I found Elastic Dump to be the easiest to use so far.

witten commented 2022-04-20 06:07:33 +00:00

Owner

Copy Link

Awesome! Let me know if I can help out with --editable or anything else.

Awesome! Let me know if I can help out with `--editable` or anything else.

witten added the

waiting for response

label 2022-04-28 20:42:10 +00:00

witten commented 2022-10-05 06:13:54 +00:00

Owner

Copy Link

Closing this for now, but feel free to follow up if you're still working on this. We can always reopen the ticket. Thanks!

Closing this for now, but feel free to follow up if you're still working on this. We can always reopen the ticket. Thanks!

witten closed this issue 2022-10-05 06:13:54 +00:00

witten removed the

waiting for response

label 2022-10-05 06:14:04 +00:00

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

spot-check

1.8.10

1.8.9

1.8.8

1.8.7

1.8.6

1.8.5

1.8.4

1.8.3

1.8.2

1.8.1

1.8.0

1.7.15

1.7.14

1.7.13

1.7.12

1.7.11

1.7.10

1.7.9

1.7.8

1.7.7

1.7.6

1.7.5

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.7.dev0

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.26

1.3.25

1.3.24

1.3.23

1.3.22

1.3.21

1.3.20

1.3.19

1.3.18

1.3.17

1.3.16

1.3.15

1.3.14

1.3.13

1.3.12

1.3.11

1.3.10

1.3.9

1.3.8

1.3.7

1.3.6

1.3.5

1.3.4

1.3.3

1.3.2

1.3.1

1.3.0

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.15

1.1.14

1.1.13

1.1.12

1.1.11

1.1.10

1.1.9

1.1.7

1.1.6

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.3

1.0.2

1.0.1

1.0.0

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

Labels

Clear labels   

bug

  

data loss

  

design finalized

  

good first issue

  

new feature area

  

question / support

  

security

  

waiting for response

No Label

bug

data loss

design finalized

good first issue

new feature area

question / support

security

waiting for response

Milestone

Clear milestone

No items

No Milestone

Assignees

Clear assignees

No Assignees

2 Participants

Notifications

Subscribe

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: borgmatic-collective/borgmatic#499

No description provided.