[vz-users] Datenverlust zwischen Vlogger und Middleware.
Abhijit Dhopate
abhijit.dhopate at gmail.com
Sa Okt 3 21:48:02 CEST 2020
Danke. Das erklärt viele. Ich habe meine vzlogger.conf aktualisiert. Aber noch nicht beim ende :( :(
Ich bekomme folgene warnung in meine vzlogger.log… und daten nicht gespeichert…
[Oct 03 17:21:51][chn6] Adding reading to queue (value=43.00 ts=1601738511360)
[Oct 03 17:21:51][push] added to uuid 25f6a4c0-3562-11ea-8128-f76b27607ea0
[Oct 03 17:21:51][chn3] CURL: Connected to 192.100.1.100 (192.100.1.100) port 8080 (#393)
[Oct 03 17:21:51][chn3] CURL: Expire in 1000 ms for 0 (transfer 0x71d073e0)
[Oct 03 17:21:51][chn3] CURL: Sent 1586 bytes..
[Oct 03 17:21:51][chn3] CURL: Sent '[ [ 1601736825000, 332 ], [ 1601736855000, 336 ], [ 1601736885000, 330 ], [ 1601736915000, 323 ], [ 1601736945000, 332 ], [ 1601736975000, 332 ], [ 1601737005000, 333 ], [ 1601737035000, 329 ], [ 1601737065000, 2784 ], [ 1601737095000, 2787 ], [ 1601737097285, 2713 ], [ 1601737125000, 2716 ], [ 1601737155000, 2746 ], [ 1601737185000, 2754 ], [ 1601737215000, 2755 ], [ 1601737245000, 2777 ], [ 1601737247111, 2681 ], [ 1601737275000, 2686 ], [ 1601737277287, 2664 ], [ 1601737305000, 2672 ], [ 1601737335000, 2650 ], [ 1601737337127, 2648 ], [ 1601737365000, 2670 ], [ 1601737367288, 2646 ], [ 1601737395000, 2662 ], [ 1601737425000, 2663 ], [ 1601737455000, 2679 ], [ 1601737457337, 2665 ], [ 1601737485000, 2680 ], [ 1601737487516, 2665 ], [ 1601737515000, 2670 ], [ 1601737545000, 2681 ], [ 1601737575000, 2677 ], [ 1601737577341, 2623 ], [ 1601737605000, 2667 ], [ 1601737607342, 347 ], [ 1601737635000, 358 ], [ 1601737665000, 360 ], [ 1601737695000, 366 ], [ 1601737697855, 2640 ], [ 1601737725000, 2647 ], [ 1601737727489, 2606 ], [ 1601737755000, 2652 ], [ 1601737757745, 2632 ], [ 1601737785000, 2657 ], [ 1601737787121, 2638 ], [ 1601737815000, 2644 ], [ 1601737817874, 354 ], [ 1601737845000, 2646 ], [ 1601737847410, 2638 ], [ 1601737875000, 2657 ], [ 1601737878708, 373 ], [ 1601737905000, 2623 ], [ 1601737907828, 2598 ], [ 1601737908933, 2619 ], [ 1601737910037, 2620 ], [ 1601737935000, 2614 ], [ 1601737937844, 351 ], [ 1601737939814, 367 ], [ 1601737965000, 2625 ], [ 1601737967606, 2613 ], [ 1601737968710, 2617 ], [ 1601737969799, 2625 ], [ 1601737995000, 2630 ] ]' bytes
[Oct 03 17:21:51][chn3] CURL: We are completely uploaded and fine
[Oct 03 17:21:51][push] CURL Request to http://192.100.1.100:5582 succeeded with code: 200
[Oct 03 17:21:51][push] send ok to url http://192.100.1.100:5582
[Oct 03 17:21:51][push] push: { "data": [ { "uuid": "25f6a4c0-3562-11ea-8128-f76b27607ea0", "tuples": [ [ 1601738511360, 43 ] ] }, { "uuid": "03c33020-3562-11ea-846f-179bde755488", "tuples": [ [ 1601738511360, 84 ] ] }, { "uuid": "c8307540-2cd3-11ea-9cb4-a946cafba208", "tuples": [ [ 1601738511360, 325 ] ] }, { "uuid": "5d3fcca0-355e-11ea-a4c0-6d550faa9601", "tuples": [ [ 1601738511360, 197 ] ] } ] }
[Oct 03 17:21:51][chn4] ==> number of tuples: 5
[Oct 03 17:21:51][chn4] compare: 1601738480737 1601738505000
[Oct 03 17:21:51][chn4] compare: 1601738505000 1601738508063
[Oct 03 17:21:51][chn4] compare: 1601738508063 1601738509152
[Oct 03 17:21:51][chn4] compare: 1601738509152 1601738510257
[Oct 03 17:21:51][chn4] compare: 1601738510257 1601738511360
[Oct 03 17:21:51][chn4] copied 64/141 values for middleware transmission
[Oct 03 17:21:51][chn3] CURL: Received 1224 bytes
[Oct 03 17:21:51][chn3] CURL: Received '{
"version": "0.3",
"exception": {
"message": "Unknown context: 'middleware.php'",
"type": "Exception",
"code": 0,
"file": "\/vz\/lib\/Router.php",
"line": 182,
"backtrace": [
{
"file": "\/vz\/lib\/Router.php",
"line": 126,
"function": "handleRaw",
"class": "Volkszaehler\\Router"
},
{
"file": "\/vz\/vendor\/php-pm\/httpkernel-adapter\/src\/Bridges\/HttpKernel.php",
"line": 87,
"function": "handle",
"class": "Volkszaehler\\Router"
},
{
"file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
"line": 454,
"function": "handle",
"class": "PHPPM\\Bridges\\HttpKernel"
},
{
"file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
"line": 418,
"function": "handleRequest",
"class": "PHPPM\\ProcessSlave"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
"line": 49,
"function": "onRequest",
"class": "PHPPM\\ProcessSlave"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
"line": 54,
"function": "call",
"class": "React\\Http\\Io\\MiddlewareRunner"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Middleware\/Reques' bytes
[Oct 03 17:21:51][chn3] CURL: Received 1448 bytes
[Oct 03 17:21:51][chn3] CURL: Received 'tBodyParserMiddleware.php",
"line": 34,
"function": "React\\Http\\Io\\{closure}",
"class": "React\\Http\\Io\\MiddlewareRunner"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
"line": 59,
"function": "__invoke",
"class": "React\\Http\\Middleware\\RequestBodyParserMiddleware"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",
"line": 54,
"function": "call",
"class": "React\\Http\\Io\\MiddlewareRunner"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Middleware\/RequestBodyBufferMiddleware.php",
"line": 58,
"function": "React\\Http\\Io\\{closure}",
"class": "React\\Http\\Io\\MiddlewareRunner"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/FulfilledPromise.php",
"line": 28,
"function": "React\\Http\\Middleware\\{closure}",
"class": "React\\Http\\Middleware\\RequestBodyBufferMiddleware"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 134,
"function": "then",
"class": "React\\Promise\\FulfilledPromise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 168,
"function": "React\\Promise\\{closure}",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 231,
"function": "settle",
"class": "React\\Promise\\Promise"
},
{
"fi' bytes
[Oct 03 17:21:51][chn3] CURL: Received 2896 bytes
[Oct 03 17:21:51][chn3] CURL: Received 'le": "\/vz\/vendor\/react\/promise\/src\/FulfilledPromise.php",
"line": 42,
"function": "React\\Promise\\{closure}",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 135,
"function": "done",
"class": "React\\Promise\\FulfilledPromise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 168,
"function": "React\\Promise\\{closure}",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",
"line": 231,
"function": "settle",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/react\/promise-stream\/src\/functions.php",
"line": 75,
"function": "React\\Promise\\{closure}",
"class": "React\\Promise\\Promise"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "React\\Promise\\Stream\\{closure}"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/HttpBodyStream.php",
"line": 80,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/HttpBodyStream.php",
"line": 179,
"function": "close",
"class": "React\\Http\\Io\\HttpBodyStream"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "handleEnd",
"class": "React\\Http\\Io\\HttpBodyStream"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/LengthLimitedStream.php",
"line": 87,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "handleData",
"class": "React\\Http\\Io\\LengthLimitedStream"
},
{
"file": "\/vz\/vendor\/react\/http\/src\/Io\/CloseProtectionStream.php",
"line": 96,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "handleData",
"class": "React\\Http\\Io\\CloseProtectionStream"
},
{
"file": "\/vz\/vendor\/react\/stream\/src\/Util.php",
"line": 71,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",
"line": 123,
"function": "React\\Stream\\{closure}",
"class": "React\\Stream\\Util"
},
{
"file": "\/vz\/vendor\/react\/stream\/src\/DuplexResourceStream.php",
"line": 193,
"function": "emit",
"class": "Evenement\\EventEmitter"
},
{
"file": "\/vz\/vendor\/react\/event-loop\/src\/StreamSelectLoop.php",
"line": 245,
"function": "handleD' bytes
[Oct 03 17:21:51][chn3] CURL: Received 721 bytes
[Oct 03 17:21:51][chn3] CURL: Received 'ata",
"class": "React\\Stream\\DuplexResourceStream"
},
{
"file": "\/vz\/vendor\/react\/event-loop\/src\/StreamSelectLoop.php",
"line": 212,
"function": "waitForStreamActivity",
"class": "React\\EventLoop\\StreamSelectLoop"
},
{
"file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",
"line": 377,
"function": "run",
"class": "React\\EventLoop\\StreamSelectLoop"
},
{
"file": "\/tmp\/dbgOnofgp",
"line": 38,
"function": "run",
"class": "PHPPM\\ProcessSlave"
}
]
},
"debug": {
"database": "pdo_mysql",
"time": 0.00034,
"uptime": 6204753120,
"load": [
2.74,
2.97,
3.32
],
"php-version": "7.3.22",
"messages": []
}
}' bytes
_____
Mit freundlichen Grüßen / With Regards,
Abhijit Dhopate
From: volkszaehler-users <volkszaehler-users-bounces at demo.volkszaehler.org> On Behalf Of Frank Richter
Sent: 03/Oct/2020 3:45 PM
To: volkszaehler.org - users <volkszaehler-users at demo.volkszaehler.org>
Subject: Re: [vz-users] Datenverlust zwischen Vlogger und Middleware.
Deine Middleware läuft auf Port 8080, und vom Push-Server wirst du keine sinnvolle Antwort bekommen. Du musst den vzlogger so konfigurieren, dass er seine Daten auf Port 8080 abliefert.
Grüße
Frank
Abhijit Dhopate <abhijit.dhopate at gmail.com <mailto:abhijit.dhopate at gmail.com> > schrieb am Sa., 3. Okt. 2020, 15:38:
Okay... Jetzt fange ich von vorne an.
Egal, was ich tue, ich erhalte von meiner Middleware kein erwartetes Antwort
wie in Wiki und Daniel geschrieben ist.
Ich benutzte das offizielle Docker-Image (von hier :
https://github.com/volkszaehler/volkszaehler.org) mit meiner zentralen
Datenbank (auch auf Synology mit mariadb).
Hier ist meine
1. middleware.json: https://pastebin.com/kEG7Ehiu
2. docker compose: https://pastebin.com/KnfSWhBW
3. config.yaml: https://pastebin.com/jCDz6SgS
Ich sehe ganz daten in http://192.100.1.100:8080/data/<UUID>.json (ich denke
Push server)
Aber keine daten in Middleware
http://192.100.1.100:5582/middleware.php/<UUID>.json
Wann ich sehe Datenbank, alle meine Kanale sind in "entities". Und sehe ich
neue daten in "data" mit neue "timestamp".
Ich finde nicht was falsch ist.
Mit freundlichen Grüßen / With Regards,
Abhijit Dhopate
-----Original Message-----
From: volkszaehler-users <volkszaehler-users-bounces at demo.volkszaehler.org <mailto:volkszaehler-users-bounces at demo.volkszaehler.org> >
On Behalf Of Daniel Lauckner
Sent: 03/Oct/2020 10:47 AM
To: volkszaehler.org <http://volkszaehler.org> - users <volkszaehler-users at demo.volkszaehler.org <mailto:volkszaehler-users at demo.volkszaehler.org> >
Subject: Re: [vz-users] Datenverlust zwischen Vlogger und Middleware.
Hallo,
am Samstag, 3. Oktober 2020 um 10:43 hat Abhijit Dhopate geschrieben:
> Ich habe gerade mit meine Raspberry Pi geprüft. Da ich direkt Image
> geflasht hatte. Da bekomme ich auch nur 1...
Wenn die Anfrage an den selben Port ging ist das ja korrekt: es Antwortet
der PUSH-Server, nicht die Middleware.
Und deswegen gehen deine Daten verloren.
mfg Daniel
-------------- nächster Teil --------------
Ein Dateianhang mit HTML-Daten wurde abgetrennt...
URL: <http://demo.volkszaehler.org/pipermail/volkszaehler-users/attachments/20201003/e81f5407/attachment-0001.html>
Mehr Informationen über die Mailingliste volkszaehler-users