<div dir="ltr">Noch was interessantes:<div>Unter var/log/messages sehe ich, dass scheinbar der Speicher voll läuft ... bis dann irgendwann nichts mehr geht ...</div><div><br></div><div>Folgender Block wiederholt sich jede Minute:</div>
<div><br></div><div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.285681] apache2 invoked oom-killer: gfp_mask=0x200da, order=0, oom_score_adj=0</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.285722] CPU: 0 PID: 12980 Comm: apache2 Not tainted 3.12.20+ #687</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.285790] [<c0013ec0>] (unwind_backtrace+0x0/0xf0) from [<c0011284>] (show_stack+0x10/0x14)</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.285824] [<c0011284>] (show_stack+0x10/0x14) from [<c041d1c0>] (dump_header.isra.13+0x74/0x1b0)</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.285863] [<c041d1c0>] (dump_header.isra.13+0x74/0x1b0) from [<c009d61c>] (oom_kill_process+0x2b8/0x438)</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.285892] [<c009d61c>] (oom_kill_process+0x2b8/0x438) from [<c009dc50>] (out_of_memory+0x27c/0x2c8)</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.285924] [<c009dc50>] (out_of_memory+0x27c/0x2c8) from [<c00a1a8c>] (__alloc_pages_nodemask+0x89c/0x8e0)</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.285954] [<c00a1a8c>] (__alloc_pages_nodemask+0x89c/0x8e0) from [<c00bb2f0>] (handle_mm_fault+0x764/0x9bc)</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.285998] [<c00bb2f0>] (handle_mm_fault+0x764/0x9bc) from [<c0424e08>] (do_page_fault+0x240/0x3f0)</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286027] [<c0424e08>] (do_page_fault+0x240/0x3f0) from [<c000835c>] (do_DataAbort+0x34/0x98)</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.286054] [<c000835c>] (do_DataAbort+0x34/0x98) from [<c042381c>] (__dabt_usr+0x3c/0x40)</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286068] Exception stack(0xc6e27fb0 to 0xc6e27ff8)</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.286085] 7fa0: b842d298 b9451fe8 00000012 00000000</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286139] 7fc0: 00000085 0003ce68 0000002a 0003cea0 b5a558e4 b9451fb0 00000000 be8752a0</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.286160] 7fe0: 00000011 be875210 b55d67f8 b55d5688 60000010 ffffffff</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286172] Mem-info:</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286182] Normal per-cpu:</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.286195] CPU 0: hi: 186, btch: 31 usd: 59</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286228] active_anon:51500 inactive_anon:51504 isolated_anon:0</div><div>
Jul 1 10:39:16 raspberrypi kernel: [391010.286228] active_file:182 inactive_file:219 isolated_file:0</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286228] unevictable:0 dirty:4294967190 writeback:154 unstable:0</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.286228] free:2048 slab_reclaimable:314 slab_unreclaimable:1907</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286228] mapped:636 shmem:634 pagetables:1990 bounce:0</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.286228] free_cma:122</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.286328] Normal free:8192kB min:8192kB low:10240kB high:12288kB active_anon:206000kB inactive_anon:206016kB active_file:728kB inactive_file:876kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:458752kB managed:447996kB mlocked:0kB dirty:4294966872kB writeback:616kB mapped:2544kB shmem:2536kB slab_reclaimable:1256kB slab_unreclaimable:7628kB kernel_stack:1096kB pagetables:7960kB unstable:0kB bounce:0kB free_cma:488kB writeback_tmp:0kB pages_scanned:25725 all_unreclaimable? yes</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.286348] lowmem_reserve[]: 0 0</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.301856] Normal: 376*4kB (UEMC) 36*8kB (MC) 2*16kB (RC) 1*32kB (R) 3*64kB (R) 2*128kB (R) 3*256kB (R) 0*512kB 1*1024kB (R) 0*2048kB 1*4096kB (R) = 8192kB</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.301929] 3927 total pagecache pages</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.301948] 2892 pages in swap cache</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.301961] Swap cache stats: add 697662, delete 694770, find 278778/342138</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.301970] Free swap = 0kB</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.301978] Total swap = 102396kB</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.513115] 114688 pages of RAM</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.513177] 2517 free pages</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.513189] 2689 reserved pages</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.513198] 1782 slab pages</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520095] 19975 pages shared</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520116] 2892 pages swap cached</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520127] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520167] [ 156] 0 156 722 0 6 133 -1000 udevd</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520186] [ 1559] 0 1559 438 13 4 16 -1000 ifplugd</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520204] [ 1581] 0 1581 438 13 5 18 -1000 ifplugd</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520223] [ 1885] 0 1885 7034 89 8 89 0 rsyslogd</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520240] [ 1886] 65534 1886 505 4 5 26 0 thd</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520258] [ 1934] 0 1934 18767 153 23 996 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520275] [ 1971] 0 1971 3578 27 6 55 0 automount</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520293] [ 1986] 104 1986 795 0 5 56 0 dbus-daemon</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520310] [ 2047] 0 2047 1094 23 6 33 0 cron</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520327] [ 2503] 0 2503 721 0 6 134 -1000 udevd</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520346] [ 2510] 0 2510 721 0 6 134 -1000 udevd</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520391] [ 2533] 1000 2533 1709 24 8 137 0 s0vz</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520412] [ 2567] 102 2567 1346 23 6 70 0 ntpd</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520429] [ 2701] 0 2701 1554 0 6 106 -1000 sshd</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520447] [ 2731] 0 2731 1074 0 5 32 0 getty</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520464] [ 2732] 0 2732 1074 0 5 32 0 getty</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520515] [ 2733] 0 2733 1074 0 5 32 0 getty</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520538] [ 2734] 0 2734 1074 0 6 32 0 getty</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520556] [ 2735] 0 2735 1074 0 6 32 0 getty</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520574] [ 2736] 0 2736 1074 0 6 32 0 getty</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520591] [ 2737] 0 2737 517 0 5 31 0 getty</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520614] [ 3024] 0 3024 1284 0 6 66 0 sudo</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520659] [ 3025] 0 3025 14551 3210 22 398 0 vzlogger</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520682] [12729] 33 12729 24007 3555 36 2287 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520700] [12748] 33 12748 23431 4116 35 1105 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520720] [12755] 33 12755 24071 4471 36 1375 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520739] [12805] 33 12805 23558 4214 35 1083 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520757] [12808] 33 12808 22532 2767 33 1537 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520775] [12816] 33 12816 23814 4486 35 1064 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520793] [12846] 33 12846 23300 4035 34 994 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520811] [12864] 33 12864 23364 4136 34 968 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520829] [12865] 33 12865 22599 2920 33 1466 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520848] [12866] 33 12866 23241 3839 34 1229 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520866] [12887] 33 12887 22601 3281 33 1009 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520884] [12888] 33 12888 24011 3126 35 2584 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520902] [12906] 33 12906 24139 3001 36 2840 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520919] [12911] 33 12911 24137 3008 36 2816 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520938] [12930] 33 12930 23561 4003 34 1243 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520956] [12943] 33 12943 24071 3949 36 1904 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.520974] [12946] 33 12946 23496 3802 35 1432 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.520993] [12958] 33 12958 24073 2958 35 2793 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521011] [12962] 33 12962 24137 3309 36 2431 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521028] [12978] 33 12978 24009 4892 35 808 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521046] [12980] 33 12980 23753 4299 35 1130 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521065] [12981] 33 12981 23049 3563 33 1148 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521082] [12982] 33 12982 23113 3592 34 1214 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521101] [12983] 33 12983 23049 3692 33 1062 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521119] [12985] 33 12985 19878 1192 27 800 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521137] [12986] 33 12986 19878 1198 27 809 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521154] [12987] 33 12987 19878 1192 27 811 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521172] [12988] 33 12988 19619 1059 26 858 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521190] [12989] 33 12989 19619 1065 26 852 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521208] [12990] 33 12990 19619 1082 26 835 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521227] [12992] 33 12992 19878 999 27 1005 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521245] [12993] 33 12993 19878 1064 27 928 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521264] [12994] 33 12994 19878 1042 27 968 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521282] [12996] 33 12996 19526 693 24 853 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521300] [12997] 33 12997 19526 692 24 854 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521318] [12998] 33 12998 19491 947 26 822 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521335] [13000] 33 13000 19526 704 24 843 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521354] [13001] 33 13001 19526 686 24 861 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521373] [13002] 33 13002 19526 705 24 842 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521391] [13003] 33 13003 19526 689 24 858 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521408] [13004] 33 13004 19526 708 24 843 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521425] [13005] 33 13005 19526 705 24 842 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521443] [13008] 33 13008 19526 685 24 862 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521461] [13009] 33 13009 19785 782 25 858 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521479] [13010] 33 13010 19526 689 24 862 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521497] [13011] 33 13011 19785 805 25 851 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521515] [13012] 33 13012 19014 544 23 869 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521533] [13013] 33 13013 18830 356 22 883 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521551] [13014] 33 13014 19014 544 23 869 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521569] [13016] 33 13016 19014 550 23 863 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521586] [13017] 33 13017 19014 551 23 863 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521623] [13018] 33 13018 19273 681 24 862 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521645] [13019] 33 13019 19273 645 24 880 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521664] [13021] 33 13021 19273 659 24 878 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521681] [13022] 33 13022 19014 590 23 869 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521699] [13023] 33 13023 19273 709 24 869 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521717] [13024] 33 13024 19273 727 24 863 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521764] [13025] 33 13025 19273 734 24 862 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521787] [13026] 33 13026 18794 208 19 961 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521805] [13028] 33 13028 18794 208 19 961 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521824] [13029] 33 13029 18794 208 19 961 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521842] [13030] 33 13030 18775 160 19 983 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521864] [13031] 33 13031 18775 160 19 983 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521910] [13033] 33 13033 18775 161 19 983 0 apache2</div><div>Jul 1 10:39:16 raspberrypi kernel: [391010.521931] [13034] 33 13034 18775 161 19 983 0 apache2</div>
<div>Jul 1 10:39:16 raspberrypi kernel: [391010.521950] [13035] 33 13035 18775 161 19 983 0 apache2</div></div><div><br></div><div><br></div><div>Und dabei wird die Menge der laufenden apache2-Prozesse immer mehr. Und das verbraucht dann wohl den Speicher (oder liege ich hier falsch).</div>
<div>Wodurch werden denn immer mehr dieser Prozesse gestartet?</div><div><br></div><div>Hier mal meine config von vzlogger:</div><div><br></div><div><div>/**</div><div>* vzlogger configuration</div><div>*</div><div>* use proper encoded JSON with javascript comments</div>
<div>*</div><div>* take a look at the wiki for detailed information:</div><div>* <a href="http://wiki.volkszaehler.org/software/controller/vzlogger#configuration">http://wiki.volkszaehler.org/software/controller/vzlogger#configuration</a></div>
<div>*/</div><div><br></div><div>{</div><div>"retry" : 30, /* how long to sleep between failed requests, in seconds */</div><div>"daemon": false, /* run periodically */</div><div>//"foreground" : true, /* dont run in background (prevents forking) */</div>
<div>"verbosity" : 1, /* between 0 and 15 */</div><div>"log" : "/var/log/vzlogger.log", /* path to logfile, optional */</div><div><br></div><div>"local" : {</div><div>"enabled" : false, /* should we start the local HTTPd for serving live readings? */</div>
<div>"port" : 80, /* the TCP port for the local HTTPd */</div><div>"index" : true, /* should we provide a index listing of available channels if no UUID was requested? */</div><div>"timeout" : 30, /* timeout for long polling comet requests, 0 disables comet, in seconds */</div>
<div>"buffer" : 600 /* how long to buffer readings for the local interface, in seconds */</div><div>},</div><div><br></div><div>"meters" : [{</div><div> "enabled" : true, /* disabled meters will be ignored */</div>
<div> "protocol" : "sml", /* see 'vzlogger -h' for list of available prot$ */</div><div> "device" : "/dev/ttyUSB0",</div><div> "aggtime" : 2, // in sekunden (optional)</div>
<div> "channels": [{</div><div> "uuid" : "1beb67d0-ad01-11e3-999b-53238ad20771",</div><div> "middleware" : "<a href="http://localhost/middleware.php">http://localhost/middleware.php</a>",</div>
<div> "aggmode" : "AVG", // Der Mittelwert für Leistung, "MAX" für Zähler, "SUM" für Counter</div><div> "identifier" : "1-0:16.7.0", /* Leistung */</div>
<div> }, {</div><div> "uuid" : "b5e94600-acf0-11e3-af91-0da9c0ff3a5a",</div><div> "middleware" : "<a href="http://localhost/middleware.php">http://localhost/middleware.php</a>",</div>
<div> "aggmode" : "MAX", // Der Mittelwert für Leistung, "MAX" für Zähler, "SUM" für Counter</div><div> "identifier" : "1-0:1.8.0", /* Wirkarbeit Bezug +A */</div>
<div> }, {</div><div> "uuid" : "cf446ee0-acf0-11e3-8492-099774ca431a",</div><div> "middleware" : "<a href="http://localhost/middleware.php">http://localhost/middleware.php</a>",</div>
<div> "aggmode" : "MAX", // Der Mittelwert für Leistung, "MAX" für Zähler, "SUM" für Counter</div><div> "identifier" : "1-0:2.8.0", /* Wirkarbeit Lieferung -A */</div>
<div> }]</div><div>}</div><div>]}</div></div><div><br></div><div>Ist das soweit in Ordnung?</div><div>Ich habe nun auch aggmode eingestellt ... auf 2 Sekunden.</div><div>Aber wenn ich im Frontend mir die Daten ansehe, dann kommen aus meiner Sicht immer noch mehrmals pro Sekunde neue Werte an. </div>
<div><br></div><div><br></div><div>Und noch zum Schluss: Wie komplex ist es denn, bei einem duplicate key den Satz einfach zu verwerfen und nicht in die Datenbank zu schreiben ???</div><div><br></div><div>VG Albert</div></div>
<div class="gmail_extra"><br><br><div class="gmail_quote">Am 1. Juli 2014 21:31 schrieb Thomas Gauweiler <span dir="ltr"><<a href="mailto:thomas@gauweiler.org" target="_blank">thomas@gauweiler.org</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
Das hatte ich auch mal!<br>
<br>
Ich hatte den vzlogger mit aggtime : 600 ( = 10 Minuten) aber ohne
echte Aggregation laufen, um die Last auf der Middleware zu
reduzieren.<br>
<br>
Meine Theorie dazu: <br>
- Die middleware ist mal etwas langsamer als sonst.<br>
- vzlogger beendet den Request mit einem Timeout, die Middleware
arbeitet aber noch und schreibt die Werte in die Datenbank.<br>
- vzlogger versucht das nächste Mal die alten Daten + die neuen
Daten zu übertragen, dadurch dauert es noch länger. Und weil die
Daten schon drin sind gibt es den Duplicate entry.<br>
- das Ganze schaukelt immer stärker auf.<br>
<br>
Meine Lösung: die aggtime auf 300 reduzieren. Seit dem keine
Probleme mehr.<br>
<br>
Liebe Grüße, Thomas<br>
<br>
PS: es mehr als einen Thomas Gauweiler in dieser Mailingliste...<br>
<br>
<br>
<br>
<div>Am 01.07.2014 19:18, schrieb Albert
Dahmen:<br>
</div><div><div class="h5">
<blockquote type="cite">
<div dir="ltr">Heute hats mich wieder erwischt :-(
<div>Diesmal hat es den ganzen Pi runter gerissen :-((</div>
<div><br>
</div>
<div>Und wieder das gleiche Thema ...</div>
<div><br>
</div>
<div>Hier ein Auszug aus dem Log:</div>
<div><br>
</div>
<div>
<div>[Jul 01 06:41:51][chn0] CURL: Timeout was reached</div>
<div>[Jul 01 06:41:51][chn1] CURL: Timeout was reached</div>
<div>[Jul 01 06:41:51][chn2] CURL: Timeout was reached</div>
<div>[Jul 01 06:42:21][chn0] CURL: Timeout was reached</div>
<div>[Jul 01 06:42:21][chn2] CURL: Timeout was reached</div>
<div>[Jul 01 06:42:21][chn1] CURL: Timeout was reached</div>
<div>[Jul 01 06:42:24][chn2] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 864750.3, 2]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '2-1404189681166' </div>
<div>[Jul 01 06:42:24][chn1] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 1030241.5, 1]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '1-1404189681166'</div>
<div>[Jul 01 06:42:24][chn0] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 342.2, 3]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '3-1404189681166' for</div>
<div>[Jul 01 06:42:25][chn2] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 864750.3, 2]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '2-1404189681166' </div>
<div>[Jul 01 06:42:25][chn1] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 1030241.5, 1]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '1-1404189681166'</div>
<div>[Jul 01 06:42:25][chn0] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 342.2, 3]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '3-1404189681166' for</div>
<div>[Jul 01 06:42:27][chn0] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 342.2, 3]:</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Zuerst kommen die timeouts ... und dann tonnenweise
Duplicate entries ... und scheinbar wird immer wieder der
gleiche Satz in die Datenbank geschrieben ... und immer wieder
der gleiche Fehler.</div>
<div><br>
</div>
<div>Dann geht es um 8:48 wie folgt weiter:</div>
<div><br>
</div>
<div>
<div>[Jul 01 08:48:17][chn2] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 864750.3, 2]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '2-1404189681166' </div>
<div>[Jul 01 08:48:23][chn0] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 342.2, 3]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '3-1404189681166' for</div>
<div>[Jul 01 08:48:29][chn1] CURL: Timeout was reached</div>
<div>[Jul 01 08:48:48][chn2] CURL: Timeout was reached</div>
<div>[Jul 01 08:48:53][chn0] CURL: Timeout was reached</div>
<div>[Jul 01 08:49:00][chn1] CURL Error from middleware:
'DBALException': 'An exception occurred while executing
'INSERT INTO data (timestamp, value, channel_id) VALUES (?,
?, ?)' with params [1404189681166, 1030241.5, 1]:</div>
<div><br>
</div>
<div>SQLSTATE[23000]: Integrity constraint violation: 1062
Duplicate entry '1-1404189681166'</div>
<div>[Jul 01 08:49:18][chn2] CURL: Timeout was reached</div>
<div>[Jul 01 08:49:24][chn0] CURL: Timeout was reached</div>
<div>[Jul 01 08:49:30][chn1] CURL: Timeout was reached</div>
<div>[Jul 01 08:49:49][chn2] CURL: Timeout was reached</div>
<div>[Jul 01 08:49:55][chn0] CURL: Timeout was reached</div>
<div>[Jul 01 08:50:01][chn1] CURL: Timeout was reached</div>
<div>[Jul 01 08:50:20][chn2] CURL: Timeout was reached</div>
<div>[Jul 01 08:50:25][chn0] CURL: Timeout was reached</div>
<div>[Jul 01 08:50:32][chn1] CURL: Timeout was reached</div>
<div>[Jul 01 08:50:50][chn2] CURL: Timeout was reached</div>
<div>[Jul 01 08:50:56][chn0] CURL: Timeout was reached</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Das geht dann so weiter bis 10:39 ... da hat sich dann der
ganze PI verabschiedet (zumindest kam ich nicht mehr per
telnet auf den PI).</div>
<div><br>
</div>
<div>Nach einem Neustart sowie manuellem Start von vzlogger (da
es ja als Service bei mir nicht mehr geht), läuft es nun
wieder.</div>
<div><br>
</div>
<div>Irgendwie komme ich nicht weiter ...</div>
<div><br>
</div>
<div>VG Albert</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">Am 30. Juni 2014 19:06 schrieb Albert
Dahmen <span dir="ltr"><<a href="mailto:albert.dahmen@gmail.com" target="_blank">albert.dahmen@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hallo Rainer,
<div><br>
</div>
<div>nein, ein Muster finde ich nicht :-( Jetzt läuft es
auch schon wieder seit ein paar Tagen durch.</div>
<div>Mit WLAN kann es nicht zusammen hängen, da der PI
direkt am Router hängt und da auch direkt die Synology
dran ist.</div>
<div><br>
</div>
<div>Per cron habe ich folgendes eingestellt:</div>
<div>
<p>* 2 * * * /usr/bin/php /var/www/<a href="http://volkszaehler.org/misc/tools/aggregate.php" target="_blank">volkszaehler.org/misc/tools/aggregate.php</a>
-m delta -l day aggregate</p>
<p>9 * * * * /usr/bin/php /var/www/<a href="http://volkszaehler.org/misc/tools/aggregate.php" target="_blank">volkszaehler.org/misc/tools/aggregate.php</a>
-m delta -l hour aggregate</p>
<p>0 3 * * * /usr/bin/php /var/www/<a href="http://volkszaehler.org/misc/tools/vzcompress2.php" target="_blank">volkszaehler.org/misc/tools/vzcompress2.php</a></p>
<p>Vielleicht hängt es ja damit zusammen ...</p>
<p>
<br>
</p>
<p>Die Fehler treten immer dann auf, wenn zuvor diverse
Male der timeout kommt. Also irgendwie steht das im
Zusammenhang ...</p>
<p>Aber warum der timeout kommt --> keine Ahnung.
Eigentlich ist die Synology 7x24 am Laufen ....</p>
<p><br>
</p>
<p>Wenn man per config einstellen könnte, dass doppelte
Sätze ignoriert werden sollen (ignore_duplicates mit
yes oder no), dann würde es sicher helfen.</p>
<p><br>
</p>
<p>VG Albert</p>
</div>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">Am 30. Juni 2014 14:27 schrieb
Rainer Gauweiler <span dir="ltr"><<a href="mailto:volkszaehler@moppl.inka.de" target="_blank">volkszaehler@moppl.inka.de</a>></span>:
<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>Hallo Albert,<br>
<br>
Am 22.06.2014 11:18, schrieb Albert Dahmen:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
(oom_kill_process+0x2b8/0x438) from
[<c009dc50>] (out_of_memory+0x27c/0x2c8)<br>
</blockquote>
<br>
Liest sich als würde Deinem System der Speicher
ausgehen.
<div><br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
[Jun 22 00:57:50][chn0] CURL: Timeout was
reached<br>
</blockquote>
<br>
</div>
Da war Dein Webserver auf der synology nicht
erreichbar.
<div><br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
[Jun 22 00:58:22][chn1] CURL Error from
middleware: 'DBALException': 'An<br>
exception occurred while executing 'INSERT
INTO data (timestamp, value,<br>
channel_id) VALUES (?, ?, ?)' with params
[1403391440635, 951536.3, 1]:<br>
<br>
SQLSTATE[23000]: Integrity constraint
violation: 1062 Duplicate entry<br>
'1-1403391440635'<br>
</blockquote>
<br>
</div>
Zu diesem Zeitstempel steht in diesem Channel
schon etwas.<br>
<br>
Ich denke bei Dir passiert folgendes:<br>
<br>
a) Es tritt irgendeine race condition auf.
Webserver nicht erreichbar, weil WLan nachts
deaktiviert ist oder irgendwelche Aufräumprozesse
laufen die den Webserver kurzfristig ab- und
wieder anschalten<br>
<br>
b) vzlogger kommt aus dem Tritt und fängt sich
nicht wieder<br>
c) vzlogger bekommt die Daten nicht los und
speichert sie im Hauptspeicher - der ist
irgendwann voll<br>
<br>
Inzwischen sind ja schon ein paar Tage vergangen -
hast Du ein Muster gefunden?<br>
<br>
Gruss<span><font color="#888888"><br>
Rainer<br>
<br>
</font></span></blockquote>
</div>
</div>
</div>
<br>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div></div></div>
</blockquote></div><br></div>