Mailing List Archive: cento crash - corrupted double-linked list

Hello,

I'm having an issue where cento crashes around 10-14 days after launch. I'm currently running:

[root@madmax ~]# cento --version
v.1.4.180420
GIT rev: 1.4-stable:e961715e3e362d70b12bdb6bedb865e5a71591e6:20180420
System Id: 7D16DBE2760C6A00
Built on: CentOS Linux release 7.4.1708 (Core)
[root@madmax ~]#

I caught the crash in a screen session, looks like this:

20/May/2018 08:57:43 [NetworkInterface.cpp:1116] [zc:enp1s0@0] [123'890 pps/0.89 Gbps][32'253/845'662'076/0/512'000 act/exp/drop/max flows][1'359'350/0 RX/TX pkt drops][0 TX pps][32'286 active flows]
20/May/2018 08:57:43 [FlowExporter.cpp:96] [zc:enp1s0@0] Flow Export Queue Len [0 tot queued][0/0 IPv4/v6][Drops queue too long 0/0 IPv4/v6][1867314376 tot exported flows]
20/May/2018 08:57:43 [NetworkInterface.cpp:1116] [zc:enp1s0@1] [27'517 pps/0.16 Gbps][32'197/845'217'650/0/512'000 act/exp/drop/max flows][0/0 RX/TX pkt drops][0 TX pps][32'216 active flows]
20/May/2018 08:57:43 [FlowExporter.cpp:96] [zc:enp1s0@1] Flow Export Queue Len [0 tot queued][0/0 IPv4/v6][Drops queue too long 0/0 IPv4/v6][1866497230 tot exported flows]
20/May/2018 08:57:43 [NetworkInterface.cpp:1116] [zc:enp1s0@2] [43'231 pps/0.34 Gbps][32'054/845'667'806/0/512'000 act/exp/drop/max flows][0/0 RX/TX pkt drops][0 TX pps][32'086 active flows]
20/May/2018 08:57:43 [FlowExporter.cpp:96] [zc:enp1s0@2] Flow Export Queue Len [0 tot queued][0/0 IPv4/v6][Drops queue too long 0/0 IPv4/v6][1867534214 tot exported flows]
20/May/2018 08:57:43 [NetworkInterface.cpp:1116] [zc:enp1s0@3] [51'056 pps/0.38 Gbps][140'624/1'098'592'923/0/512'000 act/exp/drop/max flows][0/0 RX/TX pkt drops][0 TX pps][140'755 active flows]
20/May/2018 08:57:43 [FlowExporter.cpp:96] [zc:enp1s0@3] Flow Export Queue Len [0 tot queued][0/0 IPv4/v6][Drops queue too long 0/0 IPv4/v6][2373273970 tot exported flows]
*** Error in `/usr/local/bin/cento': corrupted double-linked list (not small): 0x00007f2d83b10a10 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x7ab54)[0x7f2d944c3b54]
/lib64/libc.so.6(+0x7c821)[0x7f2d944c5821]
/usr/local/bin/cento[0x40d504]
/usr/local/bin/cento[0x40d948]
/usr/local/bin/cento[0x40d9f9]
/lib64/libpthread.so.0(+0x7e25)[0x7f2d966e3e25]
/lib64/libc.so.6(clone+0x6d)[0x7f2d9454134d]
======= Memory map: ========
00400000-00536000 r-xp 00000000 fd:00 100665017 /usr/local/bin/cento
00736000-00739000 r--p 00136000 fd:00 100665017 /usr/local/bin/cento
00739000-0074e000 rw-p 00139000 fd:00 100665017 /usr/local/bin/cento
0074e000-00755000 rw-p 00000000 00:00 0
01e83000-029a5000 rw-p 00000000 00:00 0 [heap]
2aaaaac00000-2aaacac00000 rw-s 00000000 00:26 191611 /dev/hugepages/pfring_zc_10
7f2d60000000-7f2d60021000 rw-p 00000000 00:00 0

Any thoughts on how to resolve this?

Thanks in advance,

- Mike

Hi Mike
I will contact you directly for debugging this issue.

Regards
Alfredo

> On 23 May 2018, at 20:04, Lang, Michael <mike.lang@uconn.edu> wrote:
>
> Hello,
>
> I’m having an issue where cento crashes around 10-14 days after launch. I’m currently running:
>
> [root@madmax ~]# cento --version
> v.1.4.180420
> GIT rev: 1.4-stable:e961715e3e362d70b12bdb6bedb865e5a71591e6:20180420
> System Id: 7D16DBE2760C6A00
> Built on: CentOS Linux release 7.4.1708 (Core)
> [root@madmax ~]#
>
> I caught the crash in a screen session, looks like this:
>
> 20/May/2018 08:57:43 [NetworkInterface.cpp:1116] [zc:enp1s0@0] [123'890 pps/0.89 Gbps][32'253/845'662'076/0/512'000 act/exp/drop/max flows][1'359'350/0 RX/TX pkt drops][0 TX pps][32'286 active flows]
> 20/May/2018 08:57:43 [FlowExporter.cpp:96] [zc:enp1s0@0] Flow Export Queue Len [0 tot queued][0/0 IPv4/v6][Drops queue too long 0/0 IPv4/v6][1867314376 tot exported flows]
> 20/May/2018 08:57:43 [NetworkInterface.cpp:1116] [zc:enp1s0@1] [27'517 pps/0.16 Gbps][32'197/845'217'650/0/512'000 act/exp/drop/max flows][0/0 RX/TX pkt drops][0 TX pps][32'216 active flows]
> 20/May/2018 08:57:43 [FlowExporter.cpp:96] [zc:enp1s0@1] Flow Export Queue Len [0 tot queued][0/0 IPv4/v6][Drops queue too long 0/0 IPv4/v6][1866497230 tot exported flows]
> 20/May/2018 08:57:43 [NetworkInterface.cpp:1116] [zc:enp1s0@2] [43'231 pps/0.34 Gbps][32'054/845'667'806/0/512'000 act/exp/drop/max flows][0/0 RX/TX pkt drops][0 TX pps][32'086 active flows]
> 20/May/2018 08:57:43 [FlowExporter.cpp:96] [zc:enp1s0@2] Flow Export Queue Len [0 tot queued][0/0 IPv4/v6][Drops queue too long 0/0 IPv4/v6][1867534214 tot exported flows]
> 20/May/2018 08:57:43 [NetworkInterface.cpp:1116] [zc:enp1s0@3] [51'056 pps/0.38 Gbps][140'624/1'098'592'923/0/512'000 act/exp/drop/max flows][0/0 RX/TX pkt drops][0 TX pps][140'755 active flows]
> 20/May/2018 08:57:43 [FlowExporter.cpp:96] [zc:enp1s0@3] Flow Export Queue Len [0 tot queued][0/0 IPv4/v6][Drops queue too long 0/0 IPv4/v6][2373273970 tot exported flows]
> *** Error in `/usr/local/bin/cento': corrupted double-linked list (not small): 0x00007f2d83b10a10 ***
> ======= Backtrace: =========
> /lib64/libc.so.6(+0x7ab54)[0x7f2d944c3b54]
> /lib64/libc.so.6(+0x7c821)[0x7f2d944c5821]
> /usr/local/bin/cento[0x40d504]
> /usr/local/bin/cento[0x40d948]
> /usr/local/bin/cento[0x40d9f9]
> /lib64/libpthread.so.0(+0x7e25)[0x7f2d966e3e25]
> /lib64/libc.so.6(clone+0x6d)[0x7f2d9454134d]
> ======= Memory map: ========
> 00400000-00536000 r-xp 00000000 fd:00 100665017 /usr/local/bin/cento
> 00736000-00739000 r--p 00136000 fd:00 100665017 /usr/local/bin/cento
> 00739000-0074e000 rw-p 00139000 fd:00 100665017 /usr/local/bin/cento
> 0074e000-00755000 rw-p 00000000 00:00 0
> 01e83000-029a5000 rw-p 00000000 00:00 0 [heap]
> 2aaaaac00000-2aaacac00000 rw-s 00000000 00:26 191611 /dev/hugepages/pfring_zc_10
> 7f2d60000000-7f2d60021000 rw-p 00000000 00:00 0
>
>
> Any thoughts on how to resolve this?
>
> Thanks in advance,
>
> - Mike
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it <mailto:Ntop-misc@listgateway.unipi.it>
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>

Mailing List Archive

Mailing List Archive

Attached Files: