Hi Alfredo,
Yes the behavior is the same as before:
$ sudo /usr/local/bin/n2disk10g /etc/n2disk/n2disk-eth5.conf
14/Nov/2016 09:04:21 [n2disk.c:4819] Welcome to n2disk10g v.2.6.161111 (r4672) [SandyBridge]
14/Nov/2016 09:04:21 [n2disk.c:4846] Running on 2 node(s) system with 24 core(s). NUMA affinity set to node 1.
14/Nov/2016 09:04:21 [n2disk.c:4875] Using PF_RING for packet capture
14/Nov/2016 09:04:21 [n2disk.c:4901] WARNING: If you are using standard drivers (packet capture via kernel) please disable time-pulse thread
14/Nov/2016 09:04:21 [n2disk.c:4904] Multithread support enabled
14/Nov/2016 09:04:21 [n2disk.c:5018] Dump files max size is set to 1024 MB
14/Nov/2016 09:04:21 [n2disk.c:5035] Buffer memory is set to 3 GB (x 3 pcap files)
14/Nov/2016 09:04:21 [n2disk.c:5070] Using directory /data1/captures for dump files
14/Nov/2016 09:04:21 [n2disk.c:5075] No sub-directories will be created
14/Nov/2016 09:04:21 [n2disk.c:5080] Up to 43000 files will be written before overwriting
14/Nov/2016 09:04:21 [n2disk.c:5090] Dump files max duration is set to 600 sec
14/Nov/2016 09:04:21 [n2disk.c:5106] Dumping data in 0.1 MB chunks
14/Nov/2016 09:04:21 [n2disk.c:5149] Index processing memory is set to 847 MB (x 3 index files)
14/Nov/2016 09:04:24 [n2disk.c:5339] Memory allocated successfully
14/Nov/2016 09:04:24 [n2disk.c:3597] Using time pulse timestamps
14/Nov/2016 09:04:24 [n2disk.c:3630] Started PF_RING packet reader thread for device zc:eth5
$
Running zbalance works fine:
$ sudo /usr/local/bin/zbalance_ipc -i zc:eth5 -c 99 -n 1 -m 1
14/Nov/2016 09:01:24 [zbalance_ipc.c:686] Starting balancer with 1 consumer queues..
14/Nov/2016 09:01:24 [zbalance_ipc.c:696] Run your application instances as follows:
14/Nov/2016 09:01:24 [zbalance_ipc.c:701] pfcount -i zc:99@0
14/Nov/2016 09:01:25 [zbalance_ipc.c:151] =========================
14/Nov/2016 09:01:25 [zbalance_ipc.c:152] Absolute Stats: Recv 354'797 pkts (0 drops) - Forwarded 8'190 pkts (346'607 drops)
14/Nov/2016 09:01:25 [zbalance_ipc.c:234] =========================
14/Nov/2016 09:01:26 [zbalance_ipc.c:151] =========================
14/Nov/2016 09:01:26 [zbalance_ipc.c:152] Absolute Stats: Recv 714'213 pkts (0 drops) - Forwarded 8'190 pkts (706'023 drops)
14/Nov/2016 09:01:26 [zbalance_ipc.c:224] Actual Stats: Recv 359'348.08 pps (0.00 drops) - Forwarded 0.00 pps (359'348.08 drops)
14/Nov/2016 09:01:26 [zbalance_ipc.c:234] =========================
14/Nov/2016 09:01:27 [zbalance_ipc.c:151] =========================
14/Nov/2016 09:01:27 [zbalance_ipc.c:152] Absolute Stats: Recv 1'053'124 pkts (0 drops) - Forwarded 8'190 pkts (1'044'926 drops)
14/Nov/2016 09:01:27 [zbalance_ipc.c:224] Actual Stats: Recv 338'839.84 pps (0.00 drops) - Forwarded 0.00 pps (338'831.84 drops)
14/Nov/2016 09:01:27 [zbalance_ipc.c:234] =========================
14/Nov/2016 09:01:28 [zbalance_ipc.c:151] =========================
14/Nov/2016 09:01:28 [zbalance_ipc.c:152] Absolute Stats: Recv 1'410'053 pkts (0 drops) - Forwarded 8'190 pkts (1'401'863 drops)
14/Nov/2016 09:01:28 [zbalance_ipc.c:224] Actual Stats: Recv 356'860.48 pps (0.00 drops) - Forwarded 0.00 pps (356'868.48 drops)
14/Nov/2016 09:01:28 [zbalance_ipc.c:234] =========================
14/Nov/2016 09:01:29 [zbalance_ipc.c:151] =========================
14/Nov/2016 09:01:29 [zbalance_ipc.c:152] Absolute Stats: Recv 1'782'541 pkts (0 drops) - Forwarded 8'190 pkts (1'774'351 drops)
14/Nov/2016 09:01:29 [zbalance_ipc.c:224] Actual Stats: Recv 372'419.84 pps (0.00 drops) - Forwarded 0.00 pps (372'419.84 drops)
14/Nov/2016 09:01:29 [zbalance_ipc.c:234] =========================
Here's strace output of the crash, if that helps any:
write(1, "14/Nov/2016 09:06:12 [n2disk.c:3"..., 9314/Nov/2016 09:06:12 [n2disk.c:3630] Started PF_RING packet reader thread for device zc:eth5
) = 93
stat("/sys/devices/system/node/node0/cpumap", {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
stat("/sys/devices/system/node/node1/cpumap", {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
stat("/sys/devices/system/node/node2/cpumap", 0x7ffc10d5fa60) = -1 ENOENT (No such file or directory)
stat("/sys/devices/system/node/node0/cpumap", {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
stat("/sys/devices/system/node/node1/cpumap", {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
stat("/sys/devices/system/node/node2/cpumap", 0x7ffc10d5fa40) = -1 ENOENT (No such file or directory)
set_mempolicy(MPOL_BIND, 0x2d3b3b0, 4) = 0
socket(0x1b /* PF_??? */, SOCK_RAW, 768) = 5
setsockopt(5, SOL_IP, 0x87 /* IP_??? */, "\0\0\0\0\0\0\0\0", 8) = 0
setsockopt(5, SOL_IP, 0x6e /* IP_??? */, "pfring-zc-cluster-0", 19) = 0
open("/proc/meminfo", O_RDONLY) = 6
fstat(6, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7faed3cf3000
read(6, "MemTotal: 16291360 kB\nMemF"..., 1024) = 1024
read(6, "e: 1024\nHugePages_Rsvd: "..., 1024) = 174
close(6) = 0
munmap(0x7faed3cf3000, 4096) = 0
open("/proc/mounts", O_RDONLY) = 6
fstat(6, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7faed3cf3000
read(6, "rootfs / rootfs rw 0 0\nproc /pro"..., 1024) = 1024
read(6, "ugepages hugetlbfs rw,relatime 0"..., 1024) = 35
open("/mnt/hugepages/pfring_zc_0", O_RDWR|O_CREAT, 0755) = 7
flock(7, LOCK_SH) = 0
mmap(NULL, 134217728, PROT_READ|PROT_WRITE, MAP_SHARED|MAP_LOCKED, 7, 0) = 0x7fb033200000
--- SIGBUS {si_signo=SIGBUS, si_code=BUS_ADRERR, si_addr=0x7fb033200018} ---
+++ killed by SIGBUS (core dumped) +++
Thanks,
Derek
________________________________
From: ntop-misc-bounces@listgateway.unipi.it <ntop-misc-bounces@listgateway.unipi.it> on behalf of Alfredo Cardigliano <cardigliano@ntop.org>
Sent: Sunday, November 13, 2016 7:25 AM
To: ntop-misc@listgateway.unipi.it
Subject: Re: [Ntop-misc] n2disk dumping with RHEL6 Kernel 2.6.32-642.4.2.el6.x86_64
Hi Derek
the same configuration seems to be working for me,
are you getting the same trace of the initial email? Could you provide me the full log again?
could you try running the following command and let me know if it crashes?
zbalance_ipc -i zc:eth5 -c 99 -n 1 -m 1
Thank you
Alfredo
On 11 Nov 2016, at 18:13, Spransy, Derek <dsprans@emory.edu<mailto:dsprans@emory.edu>> wrote:
Hi Alfredo,
A yum clean appears to have resolved the glibc issue. However, the original issue of n2disk crashing with multi-threaded read support is still causing it to crash.
I'm running:
$ n2disk10g -V
n2disk10g 2.6.161111 [SystemID: 9C5185AAB205A206]
The n2disk package I installed was n2disk-2.6.161111-4672.x86_64.rpm. Is that the correct one?
Thanks,
Derek
________________________________
From: ntop-misc-bounces@listgateway.unipi.it<mailto:ntop-misc-bounces@listgateway.unipi.it> <ntop-misc-bounces@listgateway.unipi.it<mailto:ntop-misc-bounces@listgateway.unipi.it>> on behalf of Alfredo Cardigliano <cardigliano@ntop.org<mailto:cardigliano@ntop.org>>
Sent: Friday, November 11, 2016 11:19 AM
To: ntop-misc@listgateway.unipi.it<mailto:ntop-misc@listgateway.unipi.it>
Subject: Re: [Ntop-misc] n2disk dumping with RHEL6 Kernel 2.6.32-642.4.2.el6.x86_64
Hi Derek
if you check my output, I am installing latest stable version, which I guess is the same you are installing,
there should be something we are missing in your installation. Could you clean up the system and follow
again the installation steps from the beginning?
Alfredo
On 11 Nov 2016, at 16:41, Spransy, Derek <dsprans@emory.edu<mailto:dsprans@emory.edu>> wrote:
Hi Alfredo,
The only thing changing is the version of n2disk that I'm installing. If I revert back to the prior version, it works fine. If I install the latest non-stable version, it also works (except I have the same problem with n2disk crashing that I had before). I don't understand why this one version would suddenly have a different glibc version requirement.
Thanks,
Derek
________________________________
From: ntop-misc-bounces@listgateway.unipi.it<mailto:ntop-misc-bounces@listgateway.unipi.it> <ntop-misc-bounces@listgateway.unipi.it<mailto:ntop-misc-bounces@listgateway.unipi.it>> on behalf of Alfredo Cardigliano <cardigliano@ntop.org<mailto:cardigliano@ntop.org>>
Sent: Friday, November 11, 2016 10:34 AM
To: ntop-misc@listgateway.unipi.it<mailto:ntop-misc@listgateway.unipi.it>
Subject: Re: [Ntop-misc] n2disk dumping with RHEL6 Kernel 2.6.32-642.4.2.el6.x86_64
Hi Derek
I just installed a Centos6 system and it is working for me:
[root@CentOS_Dev ~]# cat /etc/centos-release
CentOS release 6.8 (Final)
[root@CentOS_Dev ~]# uname -a
Linux CentOS_Dev 2.6.32-642.6.2.el6.x86_64 #1 SMP Wed Oct 26 06:52:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
[root@CentOS_Dev ~]# ls -al /usr/local/bin/n2disk10g
-rwxr-xr-x 1 root root 1006992 Nov 11 15:51 /usr/local/bin/n2disk10g
[root@CentOS_Dev ~]# ldd /usr/local/bin/n2disk10g
linux-vdso.so.1 => (0x00007ffe339a0000)
librt.so.1 => /lib64/librt.so.1 (0x00007fd44396c000)
libntapi.so => /lib64/libntapi.so (0x00007fd440eb8000)
libntos.so => /lib64/libntos.so (0x00007fd440c94000)
libsnf.so.0 => /lib64/libsnf.so.0 (0x00007fd440a7e000)
libnuma.so.1 => /usr/lib64/libnuma.so.1 (0x00007fd440873000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x00007fd440655000)
libc.so.6 => /lib64/libc.so.6 (0x00007fd4402c1000)
/lib64/ld-linux-x86-64.so.2 (0x00007fd443b7d000)
libdl.so.2 => /lib64/libdl.so.2 (0x00007fd4400bd000)
[root@CentOS_Dev ~]# n2disk10g -V
n2disk10g 2.6.161111 [SystemID: 397C27017A076A80]
Alfredo
On 11 Nov 2016, at 15:18, Spransy, Derek <dsprans@emory.edu<mailto:dsprans@emory.edu>> wrote:
Hi Luca,
My system looks identical to yours, see below. If I revert back to n2disk-2.6.161102, it works as expected.
$ ldd /usr/local/bin/n2disk10g
/usr/local/bin/n2disk10g: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /usr/local/bin/n2disk10g)
linux-vdso.so.1 => (0x00007ffca23ba000)
librt.so.1 => /lib64/librt.so.1 (0x0000003329200000)
libntapi.so => /lib64/libntapi.so (0x00007f542e5d9000)
libntos.so => /lib64/libntos.so (0x00007f542e3b5000)
libsnf.so.0 => /lib64/libsnf.so.0 (0x00007f542e19f000)
libnuma.so.1 => /usr/lib64/libnuma.so.1 (0x0000003328e00000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003328a00000)
libc.so.6 => /lib64/libc.so.6 (0x0000003328600000)
/lib64/ld-linux-x86-64.so.2 (0x0000003328200000)
libdl.so.2 => /lib64/libdl.so.2 (0x00007f542df9a000)
$ ls -l /lib64/libc.so.6
lrwxrwxrwx 1 root root 12 Sep 23 11:17 /lib64/libc.so.6 -> libc-2.12.so
$ cat /etc/redhat-release
Red Hat Enterprise Linux Server release 6.8 (Santiago)
Thanks,
Derek
________________________________
This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.
If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).
_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it<mailto:Ntop-misc@listgateway.unipi.it>
http://listgateway.unipi.it/mailman/listinfo/ntop-misc _______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it<mailto:Ntop-misc@listgateway.unipi.it>
http://listgateway.unipi.it/mailman/listinfo/ntop-misc