[vz-users] Datenverlust zwischen Vlogger und Middleware.

Abhijit Dhopate abhijit.dhopate at gmail.com
Sa Okt 3 21:48:02 CEST 2020


Danke. Das erklärt viele. Ich habe meine vzlogger.conf aktualisiert. Aber noch nicht beim ende :( :(

Ich bekomme folgene warnung in meine vzlogger.log… und daten nicht gespeichert… 

 

[Oct 03 17:21:51][chn6] Adding reading to queue (value=43.00 ts=1601738511360)

[Oct 03 17:21:51][push] added to uuid 25f6a4c0-3562-11ea-8128-f76b27607ea0

[Oct 03 17:21:51][chn3] CURL: Connected to 192.100.1.100 (192.100.1.100) port 8080 (#393)

[Oct 03 17:21:51][chn3] CURL: Expire in 1000 ms for 0 (transfer 0x71d073e0)

[Oct 03 17:21:51][chn3] CURL: Sent 1586 bytes.. 

[Oct 03 17:21:51][chn3] CURL: Sent '[ [ 1601736825000, 332 ], [ 1601736855000, 336 ], [ 1601736885000, 330 ], [ 1601736915000, 323 ], [ 1601736945000, 332 ], [ 1601736975000, 332 ], [ 1601737005000, 333 ], [ 1601737035000, 329 ], [ 1601737065000, 2784 ], [ 1601737095000, 2787 ], [ 1601737097285, 2713 ], [ 1601737125000, 2716 ], [ 1601737155000, 2746 ], [ 1601737185000, 2754 ], [ 1601737215000, 2755 ], [ 1601737245000, 2777 ], [ 1601737247111, 2681 ], [ 1601737275000, 2686 ], [ 1601737277287, 2664 ], [ 1601737305000, 2672 ], [ 1601737335000, 2650 ], [ 1601737337127, 2648 ], [ 1601737365000, 2670 ], [ 1601737367288, 2646 ], [ 1601737395000, 2662 ], [ 1601737425000, 2663 ], [ 1601737455000, 2679 ], [ 1601737457337, 2665 ], [ 1601737485000, 2680 ], [ 1601737487516, 2665 ], [ 1601737515000, 2670 ], [ 1601737545000, 2681 ], [ 1601737575000, 2677 ], [ 1601737577341, 2623 ], [ 1601737605000, 2667 ], [ 1601737607342, 347 ], [ 1601737635000, 358 ], [ 1601737665000, 360 ], [ 1601737695000, 366 ], [ 1601737697855, 2640 ], [ 1601737725000, 2647 ], [ 1601737727489, 2606 ], [ 1601737755000, 2652 ], [ 1601737757745, 2632 ], [ 1601737785000, 2657 ], [ 1601737787121, 2638 ], [ 1601737815000, 2644 ], [ 1601737817874, 354 ], [ 1601737845000, 2646 ], [ 1601737847410, 2638 ], [ 1601737875000, 2657 ], [ 1601737878708, 373 ], [ 1601737905000, 2623 ], [ 1601737907828, 2598 ], [ 1601737908933, 2619 ], [ 1601737910037, 2620 ], [ 1601737935000, 2614 ], [ 1601737937844, 351 ], [ 1601737939814, 367 ], [ 1601737965000, 2625 ], [ 1601737967606, 2613 ], [ 1601737968710, 2617 ], [ 1601737969799, 2625 ], [ 1601737995000, 2630 ] ]' bytes

[Oct 03 17:21:51][chn3] CURL: We are completely uploaded and fine

[Oct 03 17:21:51][push] CURL Request to http://192.100.1.100:5582 succeeded with code: 200

[Oct 03 17:21:51][push] send ok to url http://192.100.1.100:5582

[Oct 03 17:21:51][push] push: { "data": [ { "uuid": "25f6a4c0-3562-11ea-8128-f76b27607ea0", "tuples": [ [ 1601738511360, 43 ] ] }, { "uuid": "03c33020-3562-11ea-846f-179bde755488", "tuples": [ [ 1601738511360, 84 ] ] }, { "uuid": "c8307540-2cd3-11ea-9cb4-a946cafba208", "tuples": [ [ 1601738511360, 325 ] ] }, { "uuid": "5d3fcca0-355e-11ea-a4c0-6d550faa9601", "tuples": [ [ 1601738511360, 197 ] ] } ] }

[Oct 03 17:21:51][chn4] ==> number of tuples: 5

[Oct 03 17:21:51][chn4] compare: 1601738480737 1601738505000

[Oct 03 17:21:51][chn4] compare: 1601738505000 1601738508063

[Oct 03 17:21:51][chn4] compare: 1601738508063 1601738509152

[Oct 03 17:21:51][chn4] compare: 1601738509152 1601738510257

[Oct 03 17:21:51][chn4] compare: 1601738510257 1601738511360

[Oct 03 17:21:51][chn4] copied 64/141 values for middleware transmission

[Oct 03 17:21:51][chn3] CURL: Received 1224 bytes

[Oct 03 17:21:51][chn3] CURL: Received '{

                "version": "0.3",

                "exception": {

                                "message": "Unknown context: 'middleware.php'",

                                "type": "Exception",

                                "code": 0,

                                "file": "\/vz\/lib\/Router.php",

                                "line": 182,

                                "backtrace": [

                                                {

                                                                "file": "\/vz\/lib\/Router.php",

                                                                "line": 126,

                                                                "function": "handleRaw",

                                                                "class": "Volkszaehler\\Router"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/php-pm\/httpkernel-adapter\/src\/Bridges\/HttpKernel.php",

                                                                "line": 87,

                                                                "function": "handle",

                                                                "class": "Volkszaehler\\Router"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",

                                                                "line": 454,

                                                                "function": "handle",

                                                                "class": "PHPPM\\Bridges\\HttpKernel"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",

                                                                "line": 418,

                                                                "function": "handleRequest",

                                                                "class": "PHPPM\\ProcessSlave"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",

                                                                "line": 49,

                                                                "function": "onRequest",

                                                                "class": "PHPPM\\ProcessSlave"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",

                                                                "line": 54,

                                                                "function": "call",

                                                                "class": "React\\Http\\Io\\MiddlewareRunner"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Middleware\/Reques' bytes

[Oct 03 17:21:51][chn3] CURL: Received 1448 bytes

[Oct 03 17:21:51][chn3] CURL: Received 'tBodyParserMiddleware.php",

                                                                "line": 34,

                                                                "function": "React\\Http\\Io\\{closure}",

                                                                "class": "React\\Http\\Io\\MiddlewareRunner"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",

                                                                "line": 59,

                                                                "function": "__invoke",

                                                                "class": "React\\Http\\Middleware\\RequestBodyParserMiddleware"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Io\/MiddlewareRunner.php",

                                                                "line": 54,

                                                                "function": "call",

                                                                "class": "React\\Http\\Io\\MiddlewareRunner"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Middleware\/RequestBodyBufferMiddleware.php",

                                                                "line": 58,

                                                                "function": "React\\Http\\Io\\{closure}",

                                                                "class": "React\\Http\\Io\\MiddlewareRunner"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/promise\/src\/FulfilledPromise.php",

                                                                "line": 28,

                                                                "function": "React\\Http\\Middleware\\{closure}",

                                                                "class": "React\\Http\\Middleware\\RequestBodyBufferMiddleware"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",

                                                                "line": 134,

                                                                "function": "then",

                                                                "class": "React\\Promise\\FulfilledPromise"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",

                                                                "line": 168,

                                                                "function": "React\\Promise\\{closure}",

                                                                "class": "React\\Promise\\Promise"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",

                                                                "line": 231,

                                                                "function": "settle",

                                                                "class": "React\\Promise\\Promise"

                                                },

                                                {

                                                                "fi' bytes

[Oct 03 17:21:51][chn3] CURL: Received 2896 bytes

[Oct 03 17:21:51][chn3] CURL: Received 'le": "\/vz\/vendor\/react\/promise\/src\/FulfilledPromise.php",

                                                                "line": 42,

                                                                "function": "React\\Promise\\{closure}",

                                                                "class": "React\\Promise\\Promise"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",

                                                                "line": 135,

                                                                "function": "done",

                                                                "class": "React\\Promise\\FulfilledPromise"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",

                                                                "line": 168,

                                                                "function": "React\\Promise\\{closure}",

                                                                "class": "React\\Promise\\Promise"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/promise\/src\/Promise.php",

                                                                "line": 231,

                                                                "function": "settle",

                                                                "class": "React\\Promise\\Promise"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/promise-stream\/src\/functions.php",

                                                                "line": 75,

                                                                "function": "React\\Promise\\{closure}",

                                                                "class": "React\\Promise\\Promise"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",

                                                                "line": 123,

                                                                "function": "React\\Promise\\Stream\\{closure}"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Io\/HttpBodyStream.php",

                                                                "line": 80,

                                                                "function": "emit",

                                                                "class": "Evenement\\EventEmitter"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Io\/HttpBodyStream.php",

                                                                "line": 179,

                                                                "function": "close",

                                                                "class": "React\\Http\\Io\\HttpBodyStream"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",

                                                                "line": 123,

                                                                "function": "handleEnd",

                                                                "class": "React\\Http\\Io\\HttpBodyStream"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Io\/LengthLimitedStream.php",

                                                                "line": 87,

                                                                "function": "emit",

                                                                "class": "Evenement\\EventEmitter"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",

                                                                "line": 123,

                                                                "function": "handleData",

                                                                "class": "React\\Http\\Io\\LengthLimitedStream"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/http\/src\/Io\/CloseProtectionStream.php",

                                                                "line": 96,

                                                                "function": "emit",

                                                                "class": "Evenement\\EventEmitter"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",

                                                                "line": 123,

                                                                "function": "handleData",

                                                                "class": "React\\Http\\Io\\CloseProtectionStream"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/stream\/src\/Util.php",

                                                                "line": 71,

                                                                "function": "emit",

                                                                "class": "Evenement\\EventEmitter"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/evenement\/evenement\/src\/Evenement\/EventEmitterTrait.php",

                                                                "line": 123,

                                                                "function": "React\\Stream\\{closure}",

                                                                "class": "React\\Stream\\Util"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/stream\/src\/DuplexResourceStream.php",

                                                                "line": 193,

                                                                "function": "emit",

                                                                "class": "Evenement\\EventEmitter"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/event-loop\/src\/StreamSelectLoop.php",

                                                                "line": 245,

                                                                "function": "handleD' bytes

[Oct 03 17:21:51][chn3] CURL: Received 721 bytes

[Oct 03 17:21:51][chn3] CURL: Received 'ata",

                                                                "class": "React\\Stream\\DuplexResourceStream"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/react\/event-loop\/src\/StreamSelectLoop.php",

                                                                "line": 212,

                                                                "function": "waitForStreamActivity",

                                                                "class": "React\\EventLoop\\StreamSelectLoop"

                                                },

                                                {

                                                                "file": "\/vz\/vendor\/php-pm\/php-pm\/src\/ProcessSlave.php",

                                                                "line": 377,

                                                                "function": "run",

                                                                "class": "React\\EventLoop\\StreamSelectLoop"

                                                },

                                                {

                                                                "file": "\/tmp\/dbgOnofgp",

                                                                "line": 38,

                                                                "function": "run",

                                                                "class": "PHPPM\\ProcessSlave"

                                                }

                                ]

                },

                "debug": {

                                "database": "pdo_mysql",

                                "time": 0.00034,

                                "uptime": 6204753120,

                                "load": [

                                                2.74,

                                                2.97,

                                                3.32

                                ],

                                "php-version": "7.3.22",

                                "messages": []

                }

}' bytes

 

 

  _____  

Mit freundlichen Grüßen / With Regards,

Abhijit Dhopate

 

From: volkszaehler-users <volkszaehler-users-bounces at demo.volkszaehler.org> On Behalf Of Frank Richter
Sent: 03/Oct/2020 3:45 PM
To: volkszaehler.org - users <volkszaehler-users at demo.volkszaehler.org>
Subject: Re: [vz-users] Datenverlust zwischen Vlogger und Middleware.

 

Deine Middleware läuft auf Port 8080, und vom Push-Server wirst du keine sinnvolle Antwort bekommen. Du musst den vzlogger so konfigurieren, dass er seine Daten auf Port 8080 abliefert.

 

Grüße

Frank

 

Abhijit Dhopate <abhijit.dhopate at gmail.com <mailto:abhijit.dhopate at gmail.com> > schrieb am Sa., 3. Okt. 2020, 15:38:

Okay... Jetzt fange ich von vorne an.
Egal, was ich tue, ich erhalte von meiner Middleware kein erwartetes Antwort
wie in Wiki und Daniel geschrieben ist.

Ich benutzte das offizielle Docker-Image (von hier :
https://github.com/volkszaehler/volkszaehler.org)  mit meiner zentralen
Datenbank (auch auf Synology mit mariadb).
Hier ist meine 
1. middleware.json:  https://pastebin.com/kEG7Ehiu
2. docker compose: https://pastebin.com/KnfSWhBW
3. config.yaml: https://pastebin.com/jCDz6SgS

Ich sehe ganz daten in http://192.100.1.100:8080/data/<UUID>.json (ich denke
Push server)
Aber keine daten in Middleware
http://192.100.1.100:5582/middleware.php/<UUID>.json 

Wann ich sehe Datenbank, alle meine Kanale sind in "entities". Und sehe ich
neue daten in "data" mit neue "timestamp". 
Ich finde nicht was falsch ist. 

Mit freundlichen Grüßen / With Regards,
Abhijit Dhopate

-----Original Message-----
From: volkszaehler-users <volkszaehler-users-bounces at demo.volkszaehler.org <mailto:volkszaehler-users-bounces at demo.volkszaehler.org> >
On Behalf Of Daniel Lauckner
Sent: 03/Oct/2020 10:47 AM
To: volkszaehler.org <http://volkszaehler.org>  - users <volkszaehler-users at demo.volkszaehler.org <mailto:volkszaehler-users at demo.volkszaehler.org> >
Subject: Re: [vz-users] Datenverlust zwischen Vlogger und Middleware.

Hallo,


am Samstag, 3. Oktober 2020 um 10:43 hat Abhijit Dhopate geschrieben:
> Ich habe gerade mit meine Raspberry Pi geprüft. Da ich direkt Image 
> geflasht hatte. Da bekomme ich auch nur 1...

Wenn die Anfrage an den selben Port ging ist das ja korrekt: es Antwortet
der PUSH-Server, nicht die Middleware.

Und deswegen gehen deine Daten verloren.


mfg Daniel



-------------- nächster Teil --------------
Ein Dateianhang mit HTML-Daten wurde abgetrennt...
URL: <http://demo.volkszaehler.org/pipermail/volkszaehler-users/attachments/20201003/e81f5407/attachment-0001.html>


Mehr Informationen über die Mailingliste volkszaehler-users