Hi,
Upgrated to:
root@mhost:/var/log/ntopng# ntopng -V
v.3.1.170825 [Enterprise/Professional build]
GIT rev: dev:a9b2a02dbab3e2787ced28baeb22162b5fb4d224:20170825
Pro rev: r1132
Built on: Debian GNU/Linux 8.2 (jessie)
System Id:
Edition: Professional
License Type: Permanent
Maintenance: Until Thu Mar 22 12:28:01 2018 [209 days left]
License:
root@mhost:/var/log/ntopng#
I will let you know if the problem still present.
Thanks for all
Regards
Roberto
Sobre 24-08-2017 19:10:38, Emanuele Faranda <faranda@ntop.org> escribió:
_______________________________________________ Ntop mailing list Ntop@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop Roberto,
Thank you for the trace. I've fixed some memory leaks.
Please update to the tomorrow version of ntopng to see if the issue is fixed. If not, please monitor the system memory and tell if ntopng is the actual application that is consuming so much memory.
Emanuele
On Thu, Aug 24, 2017 at 9:10 PM, Roberto Alvarado <ralvarado@anycast.cl> wrote:
Emanuele
Here is the information, I can monitor the memory usage with zabbix and a custom template (
https://github.com/thecamels/zabbix/blob/master/templates/Template%20Specific%20Process%20Memory%20Usage.xml)
If you want to do tests, please contact me off the list and I can give you ssh access.
==32365== by 0x9339341: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x93394E5: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E0B4: g_type_register_fundamental (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x93230CB: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318645: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365==
==32365== 130 bytes in 1 blocks are possibly lost in loss record 253 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in /lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x933A129: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x93185E2: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365== by 0xFFF000925: ???
==32365==
==32365== 132 bytes in 1 blocks are possibly lost in loss record 254 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in /lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x9339FBF: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E112: g_type_register_fundamental (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x931E5BB: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318636: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365==
==32365== 132 bytes in 1 blocks are possibly lost in loss record 255 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in /lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x9339FBF: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E112: g_type_register_fundamental (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x931E621: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318636: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365==
==32365== 148 bytes in 1 blocks are possibly lost in loss record 257 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in /lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x9339D93: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E112: g_type_register_fundamental (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9328034: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318640: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365==
==32365== 148 bytes in 1 blocks are possibly lost in loss record 258 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x95AF821: g_malloc0 (in /lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x9339D93: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E112: g_type_register_fundamental (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x93230CB: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9318645: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365== by 0xFFF00090D: ???
==32365==
==32365== 155 (48 direct, 107 indirect) bytes in 1 blocks are definitely lost in loss record 259 of 302
==32365== at 0x4C29180: operator new(unsigned long) (vg_replace_malloc.c:324)
==32365== by 0x4A2B7D: Ntop::registerNagios() (Ntop.cpp:281)
==32365== by 0x482E17: main (main.cpp:128)
==32365==
==32365== 160 bytes in 1 blocks are possibly lost in loss record 260 of 302
==32365== at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365== by 0x5A51CD9: my_malloc (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A4D059: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A1FEED: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A0DD0B: mysql_server_init (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A147B6: mysql_init (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x497C54: MySQLDB::connectToDB(st_mysql*, bool) (MySQLDB.cpp:685)
==32365== by 0x497001: MySQLDB::MySQLDB(NetworkInterface*) (MySQLDB.cpp:479)
==32365== by 0x4BEFD3: BatchedMySQLDB::BatchedMySQLDB(NetworkInterface*) (BatchedMySQLDB.cpp:26)
==32365== by 0x44CB51: NetworkInterface::NetworkInterface(char const*, char const*) (NetworkInterface.cpp:167)
==32365== by 0x49C848: ParserInterface::ParserInterface(char const*, char const*) (ParserInterface.cpp:27)
==32365== by 0x4B84EC: CollectorInterface::CollectorInterface(char const*) (CollectorInterface.cpp:26)
==32365==
==32365== 184 bytes in 1 blocks are possibly lost in loss record 263 of 302
==32365== at 0x4C2AF2E: realloc (vg_replace_malloc.c:692)
==32365== by 0x95AF88D: g_realloc (in /lib/x86_64-linux-gnu/libglib-2.0.so.0.4200.1)
==32365== by 0x93392E9: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x933E2CC: g_type_register_static (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x9329BD9: g_param_type_register_static (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x932B838: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x931864A: ??? (in /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.4200.1)
==32365== by 0x400EBE9: call_init.part.0 (dl-init.c:78)
==32365== by 0x400ECD2: call_init (dl-init.c:36)
==32365== by 0x400ECD2: _dl_init (dl-init.c:126)
==32365== by 0x4001169: ??? (in /lib/x86_64-linux-gnu/ld-2.19.so)
==32365== by 0x2: ???
==32365== by 0xFFF000906: ???
==32365==
==32365== 200 bytes in 1 blocks are definitely lost in loss record 266 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x5A5368E: ??? (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A0DCF4: mysql_server_init (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x5A147B6: mysql_init (in /usr/lib/libmysqlclient.so.18.0.0)
==32365== by 0x497C54: MySQLDB::connectToDB(st_mysql*, bool) (MySQLDB.cpp:685)
==32365== by 0x4BF694: BatchedMySQLDB::queryLoop() (BatchedMySQLDB.cpp:244)
==32365== by 0x494EA8: queryLoop(void*) (MySQLDB.cpp:27)
==32365== by 0x5F9A063: start_thread (pthread_create.c:309)
==32365== by 0x845062C: clone (clone.S:111)
==32365==
==32365== 255 bytes in 6 blocks are definitely lost in loss record 268 of 302
==32365== at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365== by 0x48A548: Prefs::setOption(int, char*) (Prefs.cpp:541)
==32365== by 0x48CF2E: Prefs::loadFromFile(char const*) (Prefs.cpp:1192)
==32365== by 0x482D66: main (main.cpp:109)
==32365==
==32365== 256 bytes in 1 blocks are possibly lost in loss record 271 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x55E4C0: array_list_new (arraylist.c:36)
==32365== by 0x55B76C: json_object_new_array (json_object.c:849)
==32365== by 0x430021: Flow::flow2json() (Flow.cpp:1901)
==32365== by 0x42F2D0: Flow::serialize(bool) (Flow.cpp:1738)
==32365== by 0x44F1EA: NetworkInterface::dumpDBFlow(long, Flow*) (NetworkInterface.cpp:711)
==32365== by 0x42B2B0: Flow::dumpFlow(bool) (Flow.cpp:873)
==32365== by 0x42C814: Flow::update_hosts_stats(timeval*) (Flow.cpp:1176)
==32365== by 0x455293: flow_update_hosts_stats(GenericHashEntry*, void*) (NetworkInterface.cpp:2371)
==32365== by 0x416DF4: GenericHash::walk(bool (*)(GenericHashEntry*, void*), void*) (GenericHash.cpp:155)
==32365== by 0x4553ED: NetworkInterface::periodicStatsUpdate() (NetworkInterface.cpp:2434)
==32365== by 0x45BDE1: NetworkInterface::runHousekeepingTasks() (NetworkInterface.cpp:4443)
==32365==
==32365== 336 bytes in 1 blocks are possibly lost in loss record 273 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x40111C1: allocate_dtv (dl-tls.c:296)
==32365== by 0x40118CD: _dl_allocate_tls (dl-tls.c:460)
==32365== by 0x5F9ABE7: allocate_stack (allocatestack.c:589)
==32365== by 0x5F9ABE7: pthread_create@@GLIBC_2.2.5 (pthread_create.c:495)
==32365== by 0x4970EC: MySQLDB::startDBLoop() (MySQLDB.cpp:491)
==32365== by 0x4A7784: NetworkInterface::startDBLoop() (in /usr/bin/ntopng)
==32365== by 0x4A6E99: Ntop::registerInterface(NetworkInterface*) (Ntop.cpp:1566)
==32365== by 0x4831CD: main (main.cpp:227)
==32365==
==32365== 2,515 (40 direct, 2,475 indirect) bytes in 1 blocks are definitely lost in loss record 294 of 302
==32365== at 0x4C28C20: malloc (vg_replace_malloc.c:296)
==32365== by 0x4E450A5: ??? (in /usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365== by 0x4E455AE: ??? (in /usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365== by 0x4E434C6: ??? (in /usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365== by 0x4E43852: pcap_findalldevs (in /usr/lib/x86_64-linux-gnu/libpcap.so.1.6.2)
==32365== by 0x4AF289: Utils::getInterfaceDescription(char*, char*, int) (Utils.cpp:2212)
==32365== by 0x44C47C: NetworkInterface::NetworkInterface(char const*, char const*) (NetworkInterface.cpp:103)
==32365== by 0x49C848: ParserInterface::ParserInterface(char const*, char const*) (ParserInterface.cpp:27)
==32365== by 0x4B84EC: CollectorInterface::CollectorInterface(char const*) (CollectorInterface.cpp:26)
==32365== by 0x482FDD: main (main.cpp:165)
==32365==
==32365== 14,528 (3,024 direct, 11,504 indirect) bytes in 42 blocks are definitely lost in loss record 298 of 302
==32365== at 0x4C2AD10: calloc (vg_replace_malloc.c:623)
==32365== by 0x55AAD1: json_object_new (json_object.c:186)
==32365== by 0x55B74A: json_object_new_array (json_object.c:845)
==32365== by 0x430021: Flow::flow2json() (Flow.cpp:1901)
==32365== by 0x42F2D0: Flow::serialize(bool) (Flow.cpp:1738)
==32365== by 0x44F1EA: NetworkInterface::dumpDBFlow(long, Flow*) (NetworkInterface.cpp:711)
==32365== by 0x42B2B0: Flow::dumpFlow(bool) (Flow.cpp:873)
==32365== by 0x42C814: Flow::update_hosts_stats(timeval*) (Flow.cpp:1176)
==32365== by 0x455293: flow_update_hosts_stats(GenericHashEntry*, void*) (NetworkInterface.cpp:2371)
==32365== by 0x416DF4: GenericHash::walk(bool (*)(GenericHashEntry*, void*), void*) (GenericHash.cpp:155)
==32365== by 0x4553ED: NetworkInterface::periodicStatsUpdate() (NetworkInterface.cpp:2434)
==32365== by 0x45BDE1: NetworkInterface::runHousekeepingTasks() (NetworkInterface.cpp:4443)
==32365==
==32365== LEAK SUMMARY:
==32365== definitely lost: 3,672 bytes in 55 blocks
==32365== indirectly lost: 14,086 bytes in 188 blocks
==32365== possibly lost: 5,549 bytes in 88 blocks
==32365== still reachable: 224,012 bytes in 827 blocks
==32365== suppressed: 0 bytes in 0 blocks
==32365== Reachable blocks (those to which a pointer was found) are not shown.
==32365== To see them, rerun with: --leak-check=full --show-leak-kinds=all
==32365==
==32365== For counts of detected and suppressed errors, rerun with: -v
==32365== Use --track-origins=yes to see where uninitialised values come from
==32365== ERROR SUMMARY: 415821 errors from 124 contexts (suppressed: 0 from 0)
==32365== could not unlink /tmp/vgdb-pipe-from-vgdb-to-32365-by-root-on-???
==32365== could not unlink /tmp/vgdb-pipe-to-vgdb-from-32365-by-root-on-???
==32365== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-32365-by-root-on-???
Regards
Roberto
Sobre 24-08-2017 15:38:37, Emanuele Faranda <faranda@ntop.org> escribió:
_______________________________________________ Ntop mailing list Ntop@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop Hi Roberto,
Can you monitor the ntopng memory usage over some hours to see if that is the process which consumes memory?
I've just committed a fix for a memory leak on the Mac.cpp but it cannot affect you since you are receiving flows from nProbe. It will be very helpful if you could run ntopng with valgrind and send me the valgrind log (just the last 200 lines of log or so). Please execute
sudo valgrind --leak-check=full ntopng /etc/ntopng.conf
Regards,
Emanuele
On Thu, Aug 24, 2017 at 6:40 PM, Roberto Alvarado <ralvarado@anycast.cl> wrote:
Hi,
The problem is after some time, here is the log from the start of ntopng to the die of the process:
23/Aug/2017 11:20:05 [Ntop.cpp:1437] Setting local networks to [REMOVED]
23/Aug/2017 11:20:05 [Redis.cpp:109] Successfully connected to redis 127.0.0.1:6379@0
23/Aug/2017 11:20:05 [NtopPro.cpp:183] [LICENSE] Reading license from /etc/ntopng.license
23/Aug/2017 11:20:05 [NtopPro.cpp:118] [LICENSE] /etc/ntopng.license: unable to validate Enterprise license [License mismatch error]
23/Aug/2017 11:20:05 [NtopPro.cpp:121] [LICENSE] /etc/ntopng.license: found valid Professional license
23/Aug/2017 11:20:06 [MySQLDB.cpp:680] Attempting to connect to MySQL for interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:720] Successfully connected to MySQL [localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 11:20:06 [Ntop.cpp:1563] Registered interface tcp://127.0.0.1:5556 [id: 0]
23/Aug/2017 11:20:06 [main.cpp:252] PID stored in file /var/tmp/ntopng.pid
23/Aug/2017 11:20:06 [HTTPserver.cpp:797] Please read
https://github.com/ntop/ntopng/blob/dev/doc/README.SSL if you want to enable SSL.
23/Aug/2017 11:20:06 [Utils.cpp:427] User changed to nobody
23/Aug/2017 11:20:06 [HTTPserver.cpp:851] Web server dirs [/usr/share/ntopng/httpdocs][/usr/share/ntopng/scripts]
23/Aug/2017 11:20:06 [HTTPserver.cpp:854] HTTP server listening on port(s) 3000
23/Aug/2017 11:20:06 [MySQLDB.cpp:667] Disconnected from MySQL for interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:680] Attempting to connect to MySQL for interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:06 [MySQLDB.cpp:720] Successfully connected to MySQL [localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 11:20:06 [main.cpp:320] Working directory: /data/ntopng
23/Aug/2017 11:20:06 [main.cpp:322] Scripts/HTML pages directory: /usr/share/ntopng
23/Aug/2017 11:20:06 [Ntop.cpp:340] Welcome to ntopng x86_64 v.3.1.170821 - (C) 1998-17 ntop.org
23/Aug/2017 11:20:06 [Ntop.cpp:345] Built on Debian GNU/Linux 8.2 (jessie)
23/Aug/2017 11:20:06 [NtopPro.cpp:383] [LICENSE] System Id: [REMOVED]
23/Aug/2017 11:20:06 [NtopPro.cpp:384] [LICENSE] Edition: Professional
23/Aug/2017 11:20:06 [NtopPro.cpp:385] [LICENSE] License Type: Permanent License
23/Aug/2017 11:20:06 [NtopPro.cpp:388] [LICENSE] License: [REMOVED]
23/Aug/2017 11:20:06 [NtopPro.cpp:398] [LICENSE] Maintenance: Until Thu Mar 22 12:28:01 2018 [211 days left]
23/Aug/2017 11:20:06 [PeriodicActivities.cpp:50] Started periodic activities loop...
23/Aug/2017 11:20:06 [NetworkInterface.cpp:2241] Started packet polling on interface tcp://127.0.0.1:5556 [id: 0]...
23/Aug/2017 11:20:07 [MySQLDB.cpp:680] Attempting to connect to MySQL for interface tcp://127.0.0.1:5556...
23/Aug/2017 11:20:07 [CollectorInterface.cpp:116] Collecting flows on tcp://127.0.0.1:5556
23/Aug/2017 11:20:08 [NetworkInterface.cpp:1202] WARNING: A flow has been seen from multiple exprters or from multiple IN/OUT interfaces. Check exporters configuration.
23/Aug/2017 12:07:26 [MySQLDB.cpp:720] Successfully connected to MySQL [localhost:ntop] for interface tcp://127.0.0.1:5556
23/Aug/2017 17:57:02 [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
23/Aug/2017 17:58:01 [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
My config file:
root@mhost:/var/log/ntopng# cat /etc/ntopng/ntopng.conf
-G=/var/tmp/ntopng.pid
-i="tcp://127.0.0.1:5556"
-d="/data/ntopng"
-w="3000"
#-v=5
--max-num-hosts=300000
--local-networks=[REMOVED]
--dump-flows="mysql;localhost;ntop;[REMOVED]"
root@mhost:/var/log/ntopng#
A screenshoot of my dashboard:
https://i.dmtinc.cl/i/2017/08/24/CapturaNTOPNG428fd.png More info from syslog:
Aug 22 22:20:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:21:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:22:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:23:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:24:00 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 22 22:24:09 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:10 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory]
Aug 22 22:24:10 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:11 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:12 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:13 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory]
Aug 22 22:24:13 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:14 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:15 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:16 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory]
Aug 22 22:24:16 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:17 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:18 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory]
Aug 22 22:24:19 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory]
Aug 22 22:24:19 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186: not enough memory]
Aug 22 22:24:20 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186: not enough memory]
Aug 22 22:24:21 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186: not enough memory]
Aug 22 22:24:22 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186: not enough memory]
Aug 22 22:24:22 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186: not enough memory]
Aug 22 22:24:23 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][/usr/share/ntopng/scripts/lua/modules/i18n/init.lua:186: not enough memory]
Aug 22 22:24:24 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 'lua_utils' from file '/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:25 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][error loading module 'lua_utils' from file '/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:25 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 'lua_utils' from file '/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:26 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 'lua_utils' from file '/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:27 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 'lua_utils' from file '/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:28 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][error loading module 'lua_utils' from file '/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 22 22:24:28 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][error loading module 'lua_utils' from file '/usr/share/ntopng/scripts/lua/modules/lua_utils.lua':#012#011not enough memory]
Aug 23 11:20:02 mhost logger: ntopng stop
Aug 23 11:20:05 mhost logger: ntopng start
Aug 23 11:20:08 mhost ntopng: [NetworkInterface.cpp:1202] WARNING: A flow has been seen from multiple exprters or from multiple IN/OUT interfaces. Check exporters configuration.
Aug 23 17:57:02 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][not enough memory]
Aug 23 17:58:01 mhost ntopng: [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/minute.lua][.not enough memory
Additional preferences:
{
"ntopng.prefs.housekeeping_frequency": 5,
"ntopng.prefs.local_host_cache_duration": 3600,
"ntopng.prefs.local_host_max_idle": 300,
"ntopng.prefs.non_local_host_max_idle": 60,
"ntopng.prefs.flow_max_idle": 60,
"ntopng.prefs.active_local_host_cache_interval": 3600,
"ntopng.prefs.intf_rrd_raw_days": 1,
"ntopng.prefs.intf_rrd_1min_days": 30,
"ntopng.prefs.intf_rrd_1h_days": 100,
"ntopng.prefs.intf_rrd_1d_days": 365,
"ntopng.prefs.other_rrd_raw_days": 1,
"ntopng.prefs.other_rrd_1min_days": 30,
"ntopng.prefs.other_rrd_1h_days": 100,
"ntopng.prefs.other_rrd_1d_days": 365,
"ntopng.prefs.host_top_sites_creation": false,
"ntopng.prefs.is_local_host_cache_enabled": true,
"ntopng.prefs.is_active_local_host_cache_enabled": true,
"ntopng.prefs.tiny_flows_export_enabled": true,
"ntopng.prefs.max_num_alerts_per_entity": 1024,
"ntopng.prefs.max_num_flow_alerts": 16384,
"ntopng.prefs.flow_device_port_rrd_creation": false,
"ntopng.prefs.disable_alerts_generation": true,
"ntopng.prefs.probing_alerts": false,
"ntopng.prefs.ssl_alerts": false,
"ntopng.prefs.alerts_syslog": true,
"ntopng.prefs.alerts.slack_notifications_enabled": false,
"ntopng.prefs.alerts.dump_alerts_when_iface_is_alerted": false,
"ntopng.prefs.max_num_packets_per_tiny_flow": 3,
"ntopng.prefs.max_num_bytes_per_tiny_flow": 64,
"ntopng.prefs.safe_search_dns": 2078163920,
"ntopng.prefs.global_dns": 4294967295,
"ntopng.prefs.secondary_dns": 4294967295,
"ntopng.prefs.enable_captive_portal": false,
"ntopng.prefs.redirection_url": "http:\/\/www.ntop.org",
"ntopng.prefs.max_ui_strlen": 24,
"ntopng.prefs.host_mask": 0,
"ntopng.prefs.ldap.bind_dn": "",
"ntopng.prefs.ldap.bind_pwd": "",
"ntopng.prefs.ldap.search_path": "",
"ntopng.prefs.ldap.user_group": "",
"ntopng.prefs.ldap.admin_group": "",
"ntopng.prefs.alerts.mysql_check_open_files_limit": "1",
"ntopng.prefs.nagios_nsca_host": "localhost",
"ntopng.prefs.nagios_nsca_port": "5667",
"ntopng.prefs.nagios_send_nsca_executable": "\/usr\/local\/nagios\/bin\/send_nsca",
"ntopng.prefs.nagios_send_nsca_config": "\/usr\/local\/nagios\/etc\/send_nsca.cfg",
"ntopng.prefs.nagios_host_name": "ntopng-host",
"ntopng.prefs.nagios_service_name": "NtopngAlert",
"ntopng.prefs.default_snmp_community": "public",
"ntopng.prefs.google_apis_browser_key": "",
"ntopng.prefs.show_advanced_prefs": "true",
"ntopng.prefs.host_blacklist": "0"
}
Regards!
Roberto
Sobre 23-08-2017 4:14:34, Emanuele Faranda <faranda@ntop.org> escribió:
_______________________________________________ Ntop mailing list Ntop@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop Hi Roberto,
What is the content of your ntopng.conf file? Does the problem occur immediately or after some time? Can you post a screenshot of your ntopng dashboard?
Emanuele
On Wed, Aug 23, 2017 at 1:46 AM, Roberto Alvarado <ralvarado@anycast.cl> wrote:
Hi Folks, My ntopng is crashing every time when the housekeeping is executed, the message of the log is explicit “no enough memory”, but this problems comes out after upgrade my install to the latest devel version, do you have any clue about this, of how much memory is needed? 21/Aug/2017 20:14:22 [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/second.lua][not enough memory] 21/Aug/2017 20:14:22 [Lua.cpp:6214] WARNING: Script failure [/usr/share/ntopng/scripts/callbacks/housekeeping.lua][not enough memory] root@mhost:/var/log/ntopng# free -m total used free shared buffers cached Mem: 32163 30833 1329 428 575 25141 -/+ buffers/cache: 5116 27046 Swap: 18530 399 18131 root@mhost:/var/log/ntopng# root@mhost:/var/log/ntopng# ps aux --sort -rss USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND nobody 26971 28.1 5.8 3375504 1942968 ? Sl 16:12 76:01 ntopng /etc/ntopng/ntopng.conf mysql 19755 15.0 1.7 1809120 588236 ? Ssl Aug17 1173:54 /usr/sbin/mysqld root 838 0.0 0.1 90724 51236 ? Ss Feb17 14:29 /lib/systemd/systemd-journald root@mhost:/var/log/ntopng# ntopng -V v.3.1.170821 [Enterprise/Professional build] GIT rev: dev:d13a4a219d885e47a46b008c61fb5e24b49b4514:20170821 Pro rev: r1130 Built on: Debian GNU/Linux 8.2 (jessie) System Id: Edition: Professional License Type: Permanent Maintenance: Until Thu Mar 22 12:28:01 2018 [211 days left] License: root@mhost:/var/log/ntopng# Thanks Regards Roberto _______________________________________________ Ntop mailing list Ntop@listgateway.unipi.it [mailto:Ntop@listgateway.unipi.it]
http://listgateway.unipi.it/mailman/listinfo/ntop [
http://listgateway.unipi.it/mailman/listinfo/ntop]