mit backitup kein Influxdb und Grafana backup möglich

[Marc Berg]

@willi-wunder sagte in mit backitup kein Influxdb und Grafana backup möglich:

Die influxdb2-cli ist dann für was genau bestimmt?

Beide Pakete installieren das Kommandozeilen-Interface (CLI) für InfluxDB2 "influx", nichts weiter.
Das Paket "...-client" bringt dabei immer eine etwas aktuellere Version mit.
Da sich am Daten(Speicher-)format des InfluxDB2 schon ewig nichts mehr geändert hat, ist es für Backup-Zwecke eigentlich völlig irrelevant, welches Paket benutzt wird.
Wenn man auf Nummer sicher gehen will, nimmt man die "-cli", die ist meist "gut abgehangen".

[Willi-Wunder]

Vielen Dank für eure Infos, will ja auch etwas dazu lernen. Jetzt kommen die nächsten Schritte mit influxDB und Grafana......Vermutlich noch ein steiniger Weg, lach.

[Taddy81]

Re: mit backitup kein Influxdb und Grafana backup möglich

Guten Morgen, leider muss ich mich auch mit einem Problem an euch wenden.

Ich habe einen LXC Container unter Proxmox auf dem meine IOBroker und meine Influx (2) Instanz liegt.

Durch eure bisherige Hilfestellung konnte ich ein Backup meiner Daten durchführen. Importiere ich die Daten auf meiner neuen IO Broker Instanz werden aber keine Buckets angelegt.

Hier ein paar Ergbnisse der CLI:

influx auth list -t Jwn-2_-7uR4NIwCjEFvoxMCYzmSt2qLbfHR3yxpaqFKL9V_XAcWzuil5Tb1OpLiSlvOJ79yonzaWF1IIUPptkA== --json
[
        {
                "id": "0aa176f53b5ec000",
                "description": "admin's Token",
                "token": "oL0zQjQCzKLf0QThs2q-xjtIqpBVVsg7KwcA3lHuiwGL4KmtIaZzGt1AAUVOxA9kvmfkLVLRc8csjEqsv9s7PA==",
                "status": "active",
                "userName": "admin",
                "userID": "0aa176f5165ec000",
                "permissions": [
                        "read:/authorizations",
                        "write:/authorizations",
                        "read:/buckets",
                        "write:/buckets",
                        "read:/dashboards",
                        "write:/dashboards",
                        "read:/orgs",
                        "write:/orgs",
                        "read:/sources",
                        "write:/sources",
                        "read:/tasks",
                        "write:/tasks",
                        "read:/telegrafs",
                        "write:/telegrafs",
                        "read:/users",
                        "write:/users",
                        "read:/variables",
                        "write:/variables",
                        "read:/scrapers",
                        "write:/scrapers",
                        "read:/secrets",
                        "write:/secrets",
                        "read:/labels",
                        "write:/labels",
                        "read:/views",
                        "write:/views",
                        "read:/documents",
                        "write:/documents",
                        "read:/notificationRules",
                        "write:/notificationRules",
                        "read:/notificationEndpoints",
                        "write:/notificationEndpoints",
                        "read:/checks",
                        "write:/checks",
                        "read:/dbrp",
                        "write:/dbrp",
                        "read:/notebooks",
                        "write:/notebooks",
                        "read:/annotations",
                        "write:/annotations",
                        "read:/remotes",
                        "write:/remotes",
                        "read:/replications",
                        "write:/replications"
                ]
        },
        {
                "id": "0aa178ecd3cac000",
                "description": "admin",
                "token": "Jwn-2_-7uR4NIwCjEFvoxMCYzmSt2qLbfHR3yxpaqFKL9V_XAcWzuil5Tb1OpLiSlvOJ79yonzaWF1IIUPptkA==",
                "status": "active",
                "userName": "admin",
                "userID": "0aa176f5165ec000",
                "permissions": [
                        "read:orgs/88eaca12149fac9e/authorizations",
                        "write:orgs/88eaca12149fac9e/authorizations",
                        "read:orgs/88eaca12149fac9e/buckets",
                        "write:orgs/88eaca12149fac9e/buckets",
                        "read:orgs/88eaca12149fac9e/dashboards",
                        "write:orgs/88eaca12149fac9e/dashboards",
                        "read:/orgs/88eaca12149fac9e",
                        "write:/orgs/88eaca12149fac9e",
                        "read:orgs/88eaca12149fac9e/sources",
                        "write:orgs/88eaca12149fac9e/sources",
                        "read:orgs/88eaca12149fac9e/tasks",
                        "write:orgs/88eaca12149fac9e/tasks",
                        "read:orgs/88eaca12149fac9e/telegrafs",
                        "write:orgs/88eaca12149fac9e/telegrafs",
                        "read:/users/0aa176f5165ec000",
                        "write:/users/0aa176f5165ec000",
                        "read:orgs/88eaca12149fac9e/variables",
                        "write:orgs/88eaca12149fac9e/variables",
                        "read:orgs/88eaca12149fac9e/scrapers",
                        "write:orgs/88eaca12149fac9e/scrapers",
                        "read:orgs/88eaca12149fac9e/secrets",
                        "write:orgs/88eaca12149fac9e/secrets",
                        "read:orgs/88eaca12149fac9e/labels",
                        "write:orgs/88eaca12149fac9e/labels",
                        "read:orgs/88eaca12149fac9e/views",
                        "write:orgs/88eaca12149fac9e/views",
                        "read:orgs/88eaca12149fac9e/documents",
                        "write:orgs/88eaca12149fac9e/documents",
                        "read:orgs/88eaca12149fac9e/notificationRules",
                        "write:orgs/88eaca12149fac9e/notificationRules",
                        "read:orgs/88eaca12149fac9e/notificationEndpoints",
                        "write:orgs/88eaca12149fac9e/notificationEndpoints",
                        "read:orgs/88eaca12149fac9e/checks",
                        "write:orgs/88eaca12149fac9e/checks",
                        "read:orgs/88eaca12149fac9e/dbrp",
                        "write:orgs/88eaca12149fac9e/dbrp",
                        "read:orgs/88eaca12149fac9e/notebooks",
                        "write:orgs/88eaca12149fac9e/notebooks",
                        "read:orgs/88eaca12149fac9e/annotations",
                        "write:orgs/88eaca12149fac9e/annotations",
                        "read:orgs/88eaca12149fac9e/remotes",
                        "write:orgs/88eaca12149fac9e/remotes",
                        "read:orgs/88eaca12149fac9e/replications",
                        "write:orgs/88eaca12149fac9e/replications"
                ]
        },

Mit Jwn habe ich immer gearbeitet, aber:

root@Influx:~# influx backup --bucket iobroker --host http://172.16.0.102:8086 -t Jwn-2_-7uR4NIwCjEFvoxMCYzmSt2qLbfHR3yxpaqFKL9V_XAcWzuil5Tb1OpLiSlvOJ79yonzaWF1IIUPptkA== "/tmp/influx-test"
2024/01/03 10:13:15 INFO: Downloading metadata snapshot
Error: failed to backup metadata: failed to download metadata snapshot: 401 Unauthorized: read:authorizations is unauthorized

Mit oL0 funktioniert ein Export:

root@Influx:~# influx backup --bucket iobroker --host http://172.16.0.102:8086 -t oL0zQjQCzKLf0QThs2q-xjtIqpBVVsg7KwcA3lHuiwGL4KmtIaZzGt1AAUVOxA9kvmfkLVLRc8csjEqsv9s7PA== "/tmp/influx-test"
2024/01/03 10:39:21 INFO: Downloading metadata snapshot
2024/01/03 10:39:21 INFO: Backing up TSM for shard 4110
2024/01/03 10:39:21 WARN: Shard 4110 removed during backup
....

Log von BackitUp

Started iobroker ...
[DEBUG] [mount] - done
[DEBUG] [iobroker] - host.Influx 4335 states saved

[DEBUG] [iobroker] - host.Influx 4958 objects saved

[DEBUG] [iobroker] - Backup created: /opt/iobroker/backups/iobroker_2024_01_03-11_12_14_backupiobroker.tar.gz

[DEBUG] [iobroker] - This backup can only be restored with js-controller version up from 4.1

[DEBUG] [iobroker] - done
[DEBUG] [influxDB] - InfluxDB-Backup for  is started ...
[DEBUG] [influxDB] - Start InfluxDB Backup ...
[DEBUG] [influxDB] - InfluxDB Backup tmp directory created 
[DEBUG] [influxDB] - Backup created: /opt/iobroker/backups/influxDB_2024_01_03-11_12_17_backupiobroker.tar.gz
[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory: "/opt/iobroker/backups/influxDB_2024_01_03-11_12_17_backupiobroker"
[DEBUG] [influxDB] - InfluxDB tmp directory "/opt/iobroker/backups/influxDB_2024_01_03-11_12_17_backupiobroker" successfully deleted
[DEBUG] [influxDB] - InfluxDB-Backup for  is finish
[DEBUG] [influxDB] - InfluxDB-Backup for  is started ...
[DEBUG] [influxDB] - Start InfluxDB Backup ...
[DEBUG] [influxDB] - InfluxDB Backup tmp directory created 
[DEBUG] [influxDB] - Backup created: /opt/iobroker/backups/influxDB_2024_01_03-11_12_19_backupiobroker.tar.gz
[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory: "/opt/iobroker/backups/influxDB_2024_01_03-11_12_19_backupiobroker"
[DEBUG] [influxDB] - InfluxDB tmp directory "/opt/iobroker/backups/influxDB_2024_01_03-11_12_19_backupiobroker" successfully deleted
[DEBUG] [influxDB] - InfluxDB-Backup for  is finish
[DEBUG] [influxDB] - InfluxDB-Backup for  is started ...
[DEBUG] [influxDB] - Start InfluxDB Backup ...
[DEBUG] [influxDB] - InfluxDB Backup tmp directory created 
[DEBUG] [influxDB] - Backup created: /opt/iobroker/backups/influxDB_2024_01_03-11_12_19_backupiobroker.tar.gz
[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory: "/opt/iobroker/backups/influxDB_2024_01_03-11_12_19_backupiobroker"
[DEBUG] [influxDB] - InfluxDB tmp directory "/opt/iobroker/backups/influxDB_2024_01_03-11_12_19_backupiobroker" successfully deleted
[DEBUG] [influxDB] - InfluxDB-Backup for  is finish
[DEBUG] [influxDB] - InfluxDB-Backup for  is started ...
[DEBUG] [influxDB] - Start InfluxDB Backup ...
[DEBUG] [influxDB] - InfluxDB Backup tmp directory created 
[DEBUG] [influxDB] - Backup created: /opt/iobroker/backups/influxDB_2024_01_03-11_12_20_backupiobroker.tar.gz
[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory: "/opt/iobroker/backups/influxDB_2024_01_03-11_12_20_backupiobroker"
[DEBUG] [influxDB] - InfluxDB tmp directory "/opt/iobroker/backups/influxDB_2024_01_03-11_12_20_backupiobroker" successfully deleted
[DEBUG] [influxDB] - InfluxDB-Backup for  is finish
[DEBUG] [influxDB] - InfluxDB-Backup for  is started ...
[DEBUG] [influxDB] - Start InfluxDB Backup ...
[DEBUG] [influxDB] - InfluxDB Backup tmp directory created 
[DEBUG] [influxDB] - Backup created: /opt/iobroker/backups/influxDB_2024_01_03-11_12_21_backupiobroker.tar.gz
[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory: "/opt/iobroker/backups/influxDB_2024_01_03-11_12_21_backupiobroker"
[DEBUG] [influxDB] - InfluxDB tmp directory "/opt/iobroker/backups/influxDB_2024_01_03-11_12_21_backupiobroker" successfully deleted
[DEBUG] [influxDB] - InfluxDB-Backup for  is finish
[DEBUG] [influxDB] - InfluxDB-Backup for  is started ...
[DEBUG] [influxDB] - Start InfluxDB Backup ...
[DEBUG] [influxDB] - InfluxDB Backup tmp directory created 
[DEBUG] [influxDB] - Backup created: /opt/iobroker/backups/influxDB_2024_01_03-11_12_26_backupiobroker.tar.gz
[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory: "/opt/iobroker/backups/influxDB_2024_01_03-11_12_26_backupiobroker"
[DEBUG] [influxDB] - InfluxDB tmp directory "/opt/iobroker/backups/influxDB_2024_01_03-11_12_26_backupiobroker" successfully deleted
[DEBUG] [influxDB] - InfluxDB-Backup for  is finish
[DEBUG] [influxDB] - InfluxDB-Backup for  is started ...
[DEBUG] [influxDB] - Start InfluxDB Backup ...
[DEBUG] [influxDB] - InfluxDB Backup tmp directory created 
[DEBUG] [influxDB] - Backup created: /opt/iobroker/backups/influxDB_2024_01_03-11_12_27_backupiobroker.tar.gz
[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory: "/opt/iobroker/backups/influxDB_2024_01_03-11_12_27_backupiobroker"
[DEBUG] [influxDB] - InfluxDB tmp directory "/opt/iobroker/backups/influxDB_2024_01_03-11_12_27_backupiobroker" successfully deleted
[DEBUG] [influxDB] - InfluxDB-Backup for  is finish
[DEBUG] [influxDB] - InfluxDB-Backup for  is started ...
[DEBUG] [influxDB] - Start InfluxDB Backup ...
[DEBUG] [influxDB] - InfluxDB Backup tmp directory created 
[DEBUG] [influxDB] - Backup created: /opt/iobroker/backups/influxDB_2024_01_03-11_12_28_backupiobroker.tar.gz
[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory: "/opt/iobroker/backups/influxDB_2024_01_03-11_12_28_backupiobroker"
[DEBUG] [influxDB] - InfluxDB tmp directory "/opt/iobroker/backups/influxDB_2024_01_03-11_12_28_backupiobroker" successfully deleted
[DEBUG] [influxDB] - InfluxDB-Backup for  is finish
[DEBUG] [influxDB] - done
[DEBUG] [cifs] - used copy path: /mnt/
[DEBUG] [cifs] - Copy iobroker_2024_01_03-11_12_14_backupiobroker.tar.gz...
[DEBUG] [cifs] - Copy influxDB_2024_01_03-11_12_17_backupiobroker.tar.gz...
[DEBUG] [cifs] - Copy influxDB_2024_01_03-11_12_19_backupiobroker.tar.gz...
[DEBUG] [cifs] - Copy influxDB_2024_01_03-11_12_20_backupiobroker.tar.gz...
[DEBUG] [cifs] - Copy influxDB_2024_01_03-11_12_21_backupiobroker.tar.gz...
[DEBUG] [cifs] - Copy influxDB_2024_01_03-11_12_26_backupiobroker.tar.gz...
[DEBUG] [cifs] - Copy influxDB_2024_01_03-11_12_27_backupiobroker.tar.gz...
[DEBUG] [cifs] - Copy influxDB_2024_01_03-11_12_28_backupiobroker.tar.gz...
[DEBUG] [cifs] - done
[DEBUG] [clean] - No older backup files are deleted, because this backup was started manually
[DEBUG] [clean] - done
[DEBUG] [historyHTML] - new history html values created
[DEBUG] [historyHTML] - done
[DEBUG] [historyJSON] - new history json values created
[DEBUG] [historyJSON] - done
[DEBUG] [umount] - done
[EXIT] 0

Lade ich nun die Influx Backups über die Backitup Oberfläche hoch, werden die Buckets nicht importiert

[simatec]

@taddy81 was meinst du genau mit hochladen? Laut Log werden deine Backups mit der Auswahl des richtigen Operator Token korrekt erstellt.

Beim „hochladen“ weiß ich nicht, was du da genau meinst

[Marc Berg]

@taddy81 sagte in mit backitup kein Influxdb und Grafana backup möglich:

Lade ich nun die Influx Backups über die Backitup Oberfläche hoch, werden die Buckets nicht importiert

Ich gehe davon aus, dass du die Daten auf der neuen Instanz wiederherstellen willst, richtig?

Wenn du dort die InfluxDB neu installiert hast, benötigt du auch den Operator-Token der neuen DB. Das dürfte ein anderer sein, wenn du nicht den alten explizit beim Setup der DB angegeben hast.

[Taddy81]

@simatec

Danke für deine Antwort.

Irgendwie habe ich nun alles zerschossen, ich habe die Backup Dateien über die GUI hochgeladen und diese dann über "Sicherung abrufen" hochgeladen.
Nachdem ich dies gemacht habe, war in der Influx Datenbank kein Bucket hinzugefügt.

Anschließend habe ich noch ein paar Influx Backups hochgeladen um diese nochmals Wiederherzustellen, aber nun läuft bei "Sicherung abrufen" nur ein blauer Balken oben durch, aber es erscheinen keine Backups mehr

Wo finde ich denn unter SSH die Uploads auf der 2. Instanz?
Ein find / -name ".tar.gz" ergibt kein Ergebnis

[simatec]

@taddy81 schau mal…
https://github.com/simatec/ioBroker.backitup/wiki/Diverse-Anleitungen-für-ioBroker.backitup#influxdb2-restore

Damit sollte es funktionieren. Wichtig ist der richtige Operator Token deiner neuen Influx Installation

[Taddy81]

@simatec

Komme leider nicht weiter...

Ich habe nun eine InfluxDB importieren wollen und bin auch nach deiner Anleitung vorgegangen.

Ich habe die Organisation in Influx gleich benannt, war das nun richtig? Den Admin Token der NEUEN Influx Installation habe ich dann in die 3 Influx Instanzen geschrieben, nach einem Wiederherstellen erhalte ich folgende Fehlermeldung

Started restore ...
[DEBUG] [influxDB] - Created tmp directory
[DEBUG] [influxDB] - Start infuxDB Restore ...
[ERROR] [influxDB] - Error: failed to check existence of organization "homelab": 401 Unauthorized: unauthorized access

[DEBUG] [influxDB] - Try deleting the InfluxDB tmp directory
[DEBUG] [influxDB] - InfluxDB tmp directory was successfully deleted
[DEBUG] [influxDB] - infuxDB Restore completed successfully
[EXIT] influxDB restore done

oot@Influx2:~# influx auth list -t   r6cDtTGWFJR5UJe-jtnDkwdkHtYUPfrU25OU4Lb1rRxTEaA-vqdNZETg1MxoL3w0wTLnaNiLT4lPSzveAhkDEA== --json
[
        {
                "id": "0c5feb1b8e1fb000",
                "description": "admin's Token",
                "token": "r6cDtTGWFJR5UJe-jtnDkwdkHtYUPfrU25OU4Lb1rRxTEaA-vqdNZETg1MxoL3w0wTLnaNiLT4lPSzveAhkDEA==",
                "status": "active",
                "userName": "admin",
                "userID": "0c5feb1b389fb000",
                "permissions": [
                        "read:/authorizations",
                        "write:/authorizations",
                        "read:/buckets",
                        "write:/buckets",
                        "read:/dashboards",
                        "write:/dashboards",
                        "read:/orgs",
                        "write:/orgs",
                        "read:/sources",
                        "write:/sources",
                        "read:/tasks",
                        "write:/tasks",
                        "read:/telegrafs",
                        "write:/telegrafs",
                        "read:/users",
                        "write:/users",
                        "read:/variables",
                        "write:/variables",
                        "read:/scrapers",
                        "write:/scrapers",
                        "read:/secrets",
                        "write:/secrets",
                        "read:/labels",
                        "write:/labels",
                        "read:/views",
                        "write:/views",
                        "read:/documents",
                        "write:/documents",
                        "read:/notificationRules",
                        "write:/notificationRules",
                        "read:/notificationEndpoints",
                        "write:/notificationEndpoints",
                        "read:/checks",
                        "write:/checks",
                        "read:/dbrp",
                        "write:/dbrp",
                        "read:/notebooks",
                        "write:/notebooks",
                        "read:/annotations",
                        "write:/annotations",
                        "read:/remotes",
                        "write:/remotes",
                        "read:/replications",
                        "write:/replications"
                ]
        }
]

Und eine Frage für später, die Daten dieser 3 Influxinstanzen werden täglich in jeweils ein Langzeitbucket mit niedriger Auflösung geschrieben, ich nehme an, dass ich nur InfluxDatenbanken wiederherstellen kann, die auch in IOBroker eine Instanz haben?

[simatec]

@taddy81 sagte in mit backitup kein Influxdb und Grafana backup möglich:

[ERROR] [influxDB] - Error: failed to check existence of organization "homelab": 401 Unauthorized: unauthorized access

Auch Backitup benötigt den Admin Token

[toki1973]

Ich habe bei mir in einer eigenen Instanz influx Version1.7.10 installiert. Wie komme ich denn an den Operator Token damit das Backitup funktioniert.

[simatec]

@toki1973 InfluxDB 1.x benötigt keinen Token
https://github.com/simatec/ioBroker.backitup/wiki/ioBroker.backitup-Wiki-Deutsch#influxdb-backup