Test Adapter History 2.0.0

[apollon77]

@homoran wo kommen denn diese massiv vielen gehHistory calls her? Das sind ja mehrere pro Sekunde???
Vor allem
Für den gleichen Datenpunkt. Weil am Ende ist’s sehr einfach: jeder der calls lädt mindestens die Daten des gesamten Tages und dann werden die auf die relevante Zeit gekürzt quasi. Ich schaue nochmal ob man das optimieren kann

Und ja. GitHub weiter auf 2.0.0

[Homoran]

@apollon77 sagte in Test Adapter History 2.0.0:

wo kommen denn diese massiv vielen gehHistory calls her? Das sind ja mehrere pro Sekunde???
Vor allem
Für den gleichen Datenpunkt.

Ich denke, das liegt daran, dass ich gerade die History des Datenpunktes aufrufe
(Hoffentlich)

[apollon77]

@homoran dann wäre es aber schon ein Admin Bug das er soooooo oft fragt. Muss ich nochmal genau schauen.

[Homoran]

@apollon77 sagte in Test Adapter History 2.0.0:

ein Admin

ist aber noch 5.2.3

[apollon77]

@homoran Update mal?

[Homoran]

@apollon77 sagte in Test Adapter History 2.0.0:

@homoran Update mal?

[Homoran]

@apollon77 und wieder tausend null

Wie gehabt, erst:

2022-05-01 18:57:30.412 - error: host.iobroker-VM03 Caught by controller[0]: <--- Last few GCs --->
2022-05-01 18:57:30.416 - error: host.iobroker-VM03 Caught by controller[0]: [320902:0x4c95c00] 73098 ms: Mark-sweep 1871.8 (1987.1) -> 1867.8 (1989.6) MB, 1742.9 / 0.0 ms (average mu = 0.153, current mu = 0.042) allocation failure scavenge might not succeed
2022-05-01 18:57:30.416 - error: host.iobroker-VM03 Caught by controller[0]: [320902:0x4c95c00] 74837 ms: Mark-sweep 1883.8 (1989.6) -> 1879.9 (1992.1) MB, 1666.9 / 0.0 ms (average mu = 0.103, current mu = 0.041) allocation failure scavenge might not succeed
2022-05-01 18:57:30.416 - error: host.iobroker-VM03 Caught by controller[1]: <--- JS stacktrace --->
2022-05-01 18:57:30.416 - error: host.iobroker-VM03 Caught by controller[1]: FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[2]: 1: 0xa3aaf0 node::Abort() [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[2]: 2: 0x970199 node::FatalError(char const*, char const*) [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[3]: 3: 0xbba45e v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[4]: 4: 0xbba7d7 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[4]: 5: 0xd769e5 [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[4]: 6: 0xd7756f [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[4]: 7: 0xd853ab v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[4]: 8: 0xd88f6c v8::internal::Heap::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[5]: 9: 0xd4e73d v8::internal::Factory::AllocateRaw(int, v8::internal::AllocationType, v8::internal::AllocationAlignment) [io.history.0]
2022-05-01 18:57:30.417 - error: host.iobroker-VM03 Caught by controller[6]: 10: 0xd4a999 v8::internal::FactoryBase::AllocateRawArray(int, v8::internal::AllocationType) [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[7]: 11: 0xd4aa54 v8::internal::FactoryBase::NewFixedArrayWithFiller(v8::internal::Handle, int, v8::internal::Handle, v8::internal::AllocationType) [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[8]: 12: 0xf80ffe v8::internal::Handle v8::internal::HashTable::New(v8::internal::Isolate*, int, v8::internal::AllocationType, v8::internal::MinimumCapacity) [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[9]: 13: 0xf81cf9 v8::internal::Handle v8::internal::BaseNameDictionary::New(v8::internal::Isolate*, int, v8::internal::AllocationType, v8::internal::MinimumCapacity) [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[9]: 14: 0xf35be1 v8::internal::JSObject::MigrateToMap(v8::internal::Isolate*, v8::internal::Handle, v8::internal::Handle, int) [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[9]: 15: 0xf556cc v8::internal::LookupIterator::Delete() [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[9]: 16: 0xf2c55b v8::internal::JSReceiver::DeleteProperty(v8::internal::LookupIterator*, v8::internal::LanguageMode) [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[9]: 17: 0x10b4600 v8::internal::Runtime::DeleteObjectProperty(v8::internal::Isolate*, v8::internal::Handle, v8::internal::Handle, v8::internal::LanguageMode) [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[9]: 18: 0x10b673a v8::internal::Runtime_DeleteProperty(int, unsigned long*, v8::internal::Isolate*) [io.history.0]
2022-05-01 18:57:30.418 - error: host.iobroker-VM03 Caught by controller[9]: 19: 0x1448e19 [io.history.0]
2022-05-01 18:57:30.418 - warn: host.iobroker-VM03 instance system.adapter.history.0 terminated due to SIGABRT
2022-05-01 18:57:30.418 - info: host.iobroker-VM03 instance system.adapter.history.0 terminated with code NaN ()
2022-05-01 18:57:30.418 - info: host.iobroker-VM03 Restart adapter system.adapter.history.0 because enabled
2022-05-01 18:58:00.450 - info: host.iobroker-VM03 instance system.adapter.history.0 started with pid 323469

dann die tausend Meldungen enabled logging of....

ein paar wenige debug mit found alias

zwischendrin noch

2022-05-01 18:58:09.706 - debug: history.0 (323704) Redis Objects: Use Redis connection: 0.0.0.0:9001
2022-05-01 18:58:09.729 - debug: history.0 (323704) Objects client ready ... initialize now
2022-05-01 18:58:09.730 - debug: history.0 (323704) Objects create System PubSub Client
2022-05-01 18:58:09.731 - debug: history.0 (323704) Objects create User PubSub Client
2022-05-01 18:58:09.731 - debug: history.0 (323704) Objects client initialize lua scripts
2022-05-01 18:58:09.746 - debug: history.0 (323704) Objects connected to redis: 0.0.0.0:9001
2022-05-01 18:58:09.750 - debug: history.0 (323704) objectDB connected
2022-05-01 18:58:09.751 - debug: history.0 (323704) Redis States: Use Redis connection: 0.0.0.0:9000
2022-05-01 18:58:09.758 - debug: history.0 (323704) States create System PubSub Client
2022-05-01 18:58:09.759 - debug: history.0 (323704) States create User PubSub Client
2022-05-01 18:58:09.768 - debug: history.0 (323704) States connected to redis: 0.0.0.0:9000
2022-05-01 18:58:09.768 - debug: history.0 (323704) statesDB connected
2022-05-01 18:58:09.996 - debug: history.0 (323704) Plugin sentry Initialize Plugin (enabled=true)

und dann wieder:

Spoiler

2022-05-01 18:58:13.235 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.JEQ0646431.1.STATE","path":"/opt/iobroker/iobroker-data/history/","start":1651164932467,"end":1651424132467,"step":4800000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"onchange","limit":2000,"addId":false,"sessionId":934,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:13.236 - debug: history.0 (323704) got 2 datapoints for hm-rpc.0.JEQ0646431.1.STATE
2022-05-01 18:58:13.260 - debug: history.0 (323704) Send: 176 values in: 25ms
2022-05-01 18:58:13.261 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:13.263 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Pool.Druck_real","path":"/opt/iobroker/iobroker-data/history/","start":1651164932467,"end":1651424132467,"step":4800000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"false","aggregate":"onchange","limit":2000,"addId":false,"sessionId":934,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:13.264 - debug: history.0 (323704) got 1 datapoints for Messwerte.0.Pool.Druck_real
2022-05-01 18:58:13.298 - debug: history.0 (323704) Send: 2951 values in: 35ms
2022-05-01 18:58:13.298 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:13.303 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.JEQ0140901.1.TEMPERATURE","path":"/opt/iobroker/iobroker-data/history/","start":1651164932467,"end":1651424132467,"step":4800000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"sessionId":934,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:13.303 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:13.311 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.LEQ0773306.2.TEMPERATURE","path":"/opt/iobroker/iobroker-data/history/","start":1651164932467,"end":1651424132467,"step":4800000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"sessionId":934,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:13.312 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:13.397 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.JEQ0140901.1.TEMPERATURE
2022-05-01 18:58:13.407 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.LEQ0773306.2.TEMPERATURE
2022-05-01 18:58:13.433 - debug: history.0 (323704) Send: 63 of: 1413 in: 130ms
2022-05-01 18:58:13.433 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:13.438 - debug: history.0 (323704) Send: 59 of: 418 in: 127ms
2022-05-01 18:58:13.439 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:16.791 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.NEQ0384904.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:16.791 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:16.863 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.NEQ0384904.2.POWER
2022-05-01 18:58:16.892 - debug: history.0 (323704) Send: 26 of: 39 in: 101ms
2022-05-01 18:58:16.893 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:17.777 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.LTK0124191.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.778 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.786 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.KEQ0966548.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.786 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.794 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.KEQ0967747.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.794 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.801 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.NEQ0386317.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.802 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.812 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.LTK0124795.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.812 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.827 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.LTK0124195.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.828 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.842 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.LTK0124798.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.842 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.860 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.LTK0124143.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.862 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.886 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.REQ0777349.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.887 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.901 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.NEQ0116043.2.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.901 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.937 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.1.0001D3C99C3EFB.6.POWER","path":"/opt/iobroker/iobroker-data/history/","start":1651381096528,"end":1651424296528,"step":100000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"sessionId":60,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:17.938 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:17.972 - debug: history.0 (323704) got 2 datapoints for hm-rpc.0.LTK0124795.2.POWER
2022-05-01 18:58:18.003 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.LTK0124191.2.POWER
2022-05-01 18:58:18.013 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.KEQ0967747.2.POWER
2022-05-01 18:58:18.173 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.KEQ0966548.2.POWER
2022-05-01 18:58:18.174 - debug: history.0 (323704) Send: 283 of: 331 in: 362ms
2022-05-01 18:58:18.175 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.177 - debug: history.0 (323704) Send: 182 of: 195 in: 400ms
2022-05-01 18:58:18.178 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.182 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.NEQ0386317.2.POWER
2022-05-01 18:58:18.184 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.REQ0777349.2.POWER
2022-05-01 18:58:18.193 - debug: history.0 (323704) Send: 179 of: 192 in: 399ms
2022-05-01 18:58:18.194 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.203 - debug: history.0 (323704) got 2 datapoints for hm-rpc.0.LTK0124195.2.POWER
2022-05-01 18:58:18.206 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.LTK0124798.2.POWER
2022-05-01 18:58:18.232 - debug: history.0 (323704) Send: 200 of: 213 in: 446ms
2022-05-01 18:58:18.233 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.237 - debug: history.0 (323704) Send: 192 of: 212 in: 436ms
2022-05-01 18:58:18.238 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.240 - debug: history.0 (323704) Send: 28 of: 39 in: 354ms
2022-05-01 18:58:18.242 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.243 - debug: history.0 (323704) Send: 364 of: 1318 in: 416ms
2022-05-01 18:58:18.244 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.245 - debug: history.0 (323704) Send: 303 of: 570 in: 403ms
2022-05-01 18:58:18.246 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.249 - debug: history.0 (323704) got 1 datapoints for hm-rpc.1.0001D3C99C3EFB.6.POWER
2022-05-01 18:58:18.254 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.LTK0124143.2.POWER
2022-05-01 18:58:18.261 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.NEQ0116043.2.POWER
2022-05-01 18:58:18.265 - debug: history.0 (323704) Send: 40 of: 46 in: 328ms
2022-05-01 18:58:18.265 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.266 - debug: history.0 (323704) Send: 284 of: 292 in: 406ms
2022-05-01 18:58:18.267 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:18.274 - debug: history.0 (323704) Send: 33 of: 39 in: 372ms
2022-05-01 18:58:18.274 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:21.810 - debug: history.0 (323704) getHistory call: {"id":"hm-rega.0.1995","path":"/opt/iobroker/iobroker-data/history/","start":1651165101563,"end":1651424301563,"step":null,"count":3000,"from":false,"ack":false,"q":false,"ignoreNull":"true","aggregate":"minmax","limit":3000,"addId":false,"sessionId":96,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:21.810 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:21.818 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.JEQ0140901.1.WIND_SPEED","path":"/opt/iobroker/iobroker-data/history/","start":1650819501567,"end":1651424301567,"step":null,"count":400,"from":false,"ack":false,"q":false,"aggregate":"max","limit":400,"addId":false,"sessionId":49,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:21.818 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:21.892 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.JEQ0140901.1.WIND_SPEED
2022-05-01 18:58:21.927 - debug: history.0 (323704) got 1 datapoints for hm-rega.0.1995
2022-05-01 18:58:21.938 - debug: history.0 (323704) Send: 153 of: 167 in: 127ms
2022-05-01 18:58:21.938 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:21.942 - debug: history.0 (323704) Send: 356 of: 2640 in: 124ms
2022-05-01 18:58:21.943 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:22.776 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Wetterdaten.Regenintensitaet","path":"/opt/iobroker/iobroker-data/history/","start":1651165101563,"end":1651424301563,"step":null,"count":3000,"from":false,"ack":false,"q":false,"ignoreNull":"false","aggregate":"minmax","limit":3000,"addId":false,"sessionId":96,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:22.776 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:22.783 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.KEQ1022589.1.STATE","path":"/opt/iobroker/iobroker-data/history/","start":1651165101563,"end":1651424301563,"step":null,"count":3000,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":3000,"addId":false,"sessionId":96,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:22.784 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:22.793 - debug: history.0 (323704) getHistory call: {"id":"hm-rega.0.12770","path":"/opt/iobroker/iobroker-data/history/","start":1650819501567,"end":1651424301567,"step":null,"count":400,"from":false,"ack":false,"q":false,"aggregate":"average","limit":400,"addId":false,"sessionId":49,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:22.793 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:22.801 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.JEQ0140901.1.WIND_SPEED","path":"/opt/iobroker/iobroker-data/history/","start":1650819501567,"end":1651424301567,"step":null,"count":400,"from":false,"ack":false,"q":false,"aggregate":"min","limit":400,"addId":false,"sessionId":49,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:22.802 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:22.906 - debug: history.0 (323704) got 1 datapoints for hm-rega.0.12770
2022-05-01 18:58:22.920 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.JEQ0140901.1.WIND_SPEED
2022-05-01 18:58:22.945 - debug: history.0 (323704) got 1 datapoints for Messwerte.0.Wetterdaten.Regenintensitaet
2022-05-01 18:58:22.963 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.KEQ1022589.1.STATE
2022-05-01 18:58:22.975 - debug: history.0 (323704) Send: 165 of: 179 in: 192ms
2022-05-01 18:58:22.976 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:22.987 - debug: history.0 (323704) Send: 357 of: 2640 in: 186ms
2022-05-01 18:58:22.988 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:23.006 - debug: history.0 (323704) Send: 16 of: 21 in: 230ms
2022-05-01 18:58:23.006 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:23.010 - debug: history.0 (323704) Send: 368 of: 3430 in: 218ms
2022-05-01 18:58:23.010 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:42.385 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Solaranlage.Momentanwerte.Solarestimate2","path":"/opt/iobroker/iobroker-data/history/","start":1651356000000,"end":1651442400000,"step":null,"count":300,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":300,"addId":false,"sessionId":875,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:42.386 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:42.393 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Solaranlage.Momentanwerte.Leistung_AC_aktuell","path":"/opt/iobroker/iobroker-data/history/","start":1651356000000,"end":1651442400000,"step":null,"count":300,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":300,"addId":false,"sessionId":875,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:42.393 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:42.398 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Solaranlage.Momentanwerte.Eigenverbrauch","path":"/opt/iobroker/iobroker-data/history/","start":1651356000000,"end":1651442400000,"step":null,"count":300,"from":false,"ack":false,"q":false,"ignoreNull":"false","aggregate":"minmax","limit":300,"addId":false,"sessionId":875,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:42.399 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:42.406 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Stromzaehler.Momentanwerte.akt_Verbrauch","path":"/opt/iobroker/iobroker-data/history/","start":1651356000000,"end":1651442400000,"step":null,"count":300,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":300,"addId":false,"sessionId":875,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:42.407 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:42.413 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Stromzaehler.Momentanwerte.akt_Einspeisung","path":"/opt/iobroker/iobroker-data/history/","start":1651356000000,"end":1651442400000,"step":null,"count":300,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":300,"addId":false,"sessionId":875,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:42.413 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:42.482 - debug: history.0 (323704) got 4 datapoints for Messwerte.0.Solaranlage.Momentanwerte.Leistung_AC_aktuell
2022-05-01 18:58:42.499 - debug: history.0 (323704) got 6 datapoints for Messwerte.0.Solaranlage.Momentanwerte.Eigenverbrauch
2022-05-01 18:58:42.512 - debug: history.0 (323704) got 2 datapoints for Messwerte.0.Stromzaehler.Momentanwerte.akt_Einspeisung
2022-05-01 18:58:42.516 - debug: history.0 (323704) got 1 datapoints for Messwerte.0.Solaranlage.Momentanwerte.Solarestimate2
2022-05-01 18:58:42.571 - debug: history.0 (323704) Send: 161 of: 6024 in: 178ms
2022-05-01 18:58:42.571 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:42.589 - debug: history.0 (323704) Send: 157 of: 736 in: 204ms
2022-05-01 18:58:42.589 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:42.595 - debug: history.0 (323704) Send: 152 of: 4825 in: 182ms
2022-05-01 18:58:42.595 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:42.612 - debug: history.0 (323704) got 5 datapoints for Messwerte.0.Stromzaehler.Momentanwerte.akt_Verbrauch
2022-05-01 18:58:42.652 - debug: history.0 (323704) Send: 178 of: 6341 in: 254ms
2022-05-01 18:58:42.652 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:42.694 - debug: history.0 (323704) Send: 241 of: 8896 in: 288ms
2022-05-01 18:58:42.694 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:43.234 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.JEQ0646431.1.STATE","path":"/opt/iobroker/iobroker-data/history/","start":1651164962469,"end":1651424162469,"step":4800000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"onchange","limit":2000,"addId":false,"sessionId":935,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:43.234 - debug: history.0 (323704) got 2 datapoints for hm-rpc.0.JEQ0646431.1.STATE
2022-05-01 18:58:43.271 - debug: history.0 (323704) Send: 176 values in: 37ms
2022-05-01 18:58:43.271 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:43.273 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Pool.Druck_real","path":"/opt/iobroker/iobroker-data/history/","start":1651164962469,"end":1651424162469,"step":4800000,"count":500,"from":false,"ack":false,"q":false,"ignoreNull":"false","aggregate":"onchange","limit":2000,"addId":false,"sessionId":935,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:43.273 - debug: history.0 (323704) got 1 datapoints for Messwerte.0.Pool.Druck_real
2022-05-01 18:58:43.303 - debug: history.0 (323704) Send: 2951 values in: 30ms
2022-05-01 18:58:43.303 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:43.310 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.JEQ0140901.1.TEMPERATURE","path":"/opt/iobroker/iobroker-data/history/","start":1651164962469,"end":1651424162469,"step":4800000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"sessionId":935,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:43.310 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:43.316 - debug: history.0 (323704) getHistory call: {"id":"hm-rpc.0.LEQ0773306.2.TEMPERATURE","path":"/opt/iobroker/iobroker-data/history/","start":1651164962469,"end":1651424162469,"step":4800000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"sessionId":935,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:43.316 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:43.383 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.JEQ0140901.1.TEMPERATURE
2022-05-01 18:58:43.396 - debug: history.0 (323704) got 1 datapoints for hm-rpc.0.LEQ0773306.2.TEMPERATURE
2022-05-01 18:58:43.410 - debug: history.0 (323704) Send: 63 of: 1413 in: 100ms
2022-05-01 18:58:43.411 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:43.419 - debug: history.0 (323704) Send: 59 of: 418 in: 103ms
2022-05-01 18:58:43.419 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.web.0 from system.adapter.history.0
2022-05-01 18:58:51.231 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Solaranlage.Momentanwerte.Leistung_String1","path":"/opt/iobroker/iobroker-data/history/","start":1651334400000,"end":1651424330980,"step":3600000,"count":500,"from":false,"ack":false,"q":false,"aggregate":"minmax","limit":2000,"addId":false,"returnNewestEntries":false,"percentile":null,"quantile":null,"integralUnit":null,"integralInterpolation":null,"removeBorderValues":false,"round":null}
2022-05-01 18:58:51.232 - debug: history.0 (323704) use parallel requests for getHistory
2022-05-01 18:58:51.293 - debug: history.0 (323704) got 6 datapoints for Messwerte.0.Solaranlage.Momentanwerte.Leistung_String1
2022-05-01 18:58:51.372 - debug: history.0 (323704) Send: 19 of: 8168 in: 141ms
2022-05-01 18:58:51.372 - debug: history.0 (323704) sendTo "getHistory" to system.adapter.admin.0 from system.adapter.history.0
2022-05-01 18:58:52.856 - debug: history.0 (323704) sendTo "features" to system.adapter.admin.0 from system.adapter.history.0
2022-05-01 18:58:52.966 - debug: history.0 (323704) getHistory call: {"id":"Messwerte.0.Solaranlage.Momentanwerte.Eigenverbrauch","path":"/opt/iobroker/iobroker-

Hat lange gedauert, aber habe ich das richtig verstanden, dass erst der gesamte Tag eingelesen wird, mit allen DPs?
Das sind bei mir etwa 50MB

[apollon77]

@homoran kann das sein das auch deine Vis so oft alles neu lädt?!

Also die Abfolge passt ja. Zuerst der Crash (was genau loggt er denn VOR dem Crash??) dann startet er neu, aktiviert alle datenpunkte und dann kommen ggf von Vis oder admin Dinge rein.

ich schaue heute Abend nochmal log weil an sich sollte das alles nicht sooooo wild sein mit RAM weil an sich die datenabfrage und nem extra Prozess passiert.

[apollon77]

Hi All,

GitHub hat nochmal ein paar nderungen erfahren - primär im Umgang mit dem Abfragen von Daten und versucht dort Dinge zu optimieren. Version bleibt weiterhin 2.0.0

[Marty56]

@apollon77
Hallo,

Super, dass der Adapter überarbeitet wird. Endlich!!! Juhuuu.

Was mir immer wieder passiert ist,
dass irgendein Sensor Mist in die History schreibt, die Daten versaut und die Diagramme unbrauchbar macht.

Es wäre wünschenswert, wenn man

1. Datenpunkte aus der History per UI löschen, ändern und hinzufügen könnte.

2. beim Editieren von Datenpunkte in der History DB, muss natürlich auch der Zeitpunkt änderbar sein.

3. Was auch noch super wäre, wenn man alle Datenpunkte, die man logt an einer Stelle, nämlich dem Adapter wiederfinden würde und dort zentral verwalten könnte.
   Man muss jedesmal in den Verzeichnisbäumen der Datenpunkte suchen, das nervt total und ist unübersichtlich. Was mir auch schon passiert ist, dass ich einen Datenpunkt vergessen habe, und der hat mir dann die Harddisk voll gemacht.

Ich bin mir nicht ganz sicher, ob das im Change Log beinhaltet ist. Habe es aber beim Überfliegen nicht gefunden.

Und ein verwandtes Thema: alle Grafik Module für VIS können max nur 2 Jahre darstellen. Flot kann, wenn man die URL umständlich editiert auch 9 Jahre darstellen. Es wäre schön, wenn man dieses Defizit auch beheben könnte.

Liebe Grüße

Martin

[apollon77]

@marty56

1.) geht schon seit Admin5

2.) Nein geht nicht aktuell. War bisher noch kein Usecase. Wäre ein Admin Feature-Request im ersten schritt. Wenn dort muss man zusätzlich die 3 Adapter anpassen.

3.) Nein auch das wird so bleiben. Admin ist "die zentrale Stelle" und du kannst im Admin oben rechts nach der "History instanz" filtern, dann hast Du alle die so loggen. Was fehlt noch das das "die zentrale Stelle ist"?

Vis-Modul ... Wenn was fehlt bitte Github requests anlegen. Technisch kein Stress, aber Daten für 9 Jahre?? Mal abgesehen von der Zeit die History brauchen würde alle JSON-Files (9x365) von der SD zu kratzen und zu verarbeiten und den Datenmengen ... was willst DU auf dem zeitraum sehen"?

[Homoran]

@marty56 sagte in Test Adapter History 2.0.0:

Datenpunkte aus der History per UI löschen, ändern und hinzufügen könnte.

geht!
Expertenmodus - Wert anklicken - editieren oder löschen (oben rech

[Marty56]

@apollon77
Danke fürs Feedback.
Es scheint mehr zu gehen, als ich wusste. Auf den Expertenmodus wäre ich nie gekommen.

Und dass man nach History Instanz filtern kann, wusste ich auch nicht.

Muss ich gleich mal alles ausprobieren.
Ok, User Inkompetenz. Ich schäme mich.

[Marty56]

@apollon77
9 Jahre. Mein Anwendung ist meine Solarnanlage, die jetzt schon 12 Jahre läuft und wo ich in die History DB alle Werte per Script manuell eingetragen habe.
Da habe ich nur einen Wert pro Jahr, bzw. 12 wenn ich die Monatsdarstellung wähle.
Das sollte machbar sein.

[apollon77]

@marty56 sagte in Test Adapter History 2.0.0:

Da habe ich nur einen Wert pro Jahr, bzw. 12 wenn ich die Monatsdarstellung wähle.

Wie meinst Du das?

[Sneak-L8]

@apollon77 Ich glaube ihm ist nicht klar, dass alle Daten in einem Json (pro Tag) gehalten werden. Also nicht nur der State den er einal am Tag speichert. Wenn die Werte dieses States das einzige sind, was in der Hostiry liegt, dann sollte es tatschlich kein Problem sein.
@Marty56 Wenn da aber auch andere States geloggt werden, dann landen die mit den von Dir angesprochennen Werten zusammen in einer Json-Datei pro Tag. Die werden also auch alle mitgelesen (und gefiltert), um die Auswertung zu machen. Ist halt keine Datenbank.

[paul53]

@sneak-l8 sagte: zusammen in einer Json-Datei pro Tag.

Bisher war es eine Json-Datei pro Datenpunkt und Tag. Hat sich das geändert?

[Homoran]

@sneak-l8 sagte in Test Adapter History 2.0.0:

dann landen die mit den von Dir angesprochennen Werten zusammen in einer Json-Datei pro Tag

du hast pro Tag und Datenpunkt ein eigenes json

[apollon77]

@paul53 Ne hat sich nicht geändert. Ein File pro Datenpunkt pro Tag

[Marty56]

@sneak-l8 Ich habe das Verzeichnis angeschaut, in der die History ihre Jsons ablegt und bei mir wird nur dann eine Datei angelegt, wenn sich der Datenpunkt ändert.

Das wären in meinem Beispiel bei 10 Jahren, genau 10 Files, die die Jahreswerte speichern und 240 files, für die Monatswerte.

Muss ich woanders schauen?
Ich habe unter /opt/iobroker/history geschaut. IOB läuft unter Linux