Mailing List Archive

nscrub installation
Hi all,

I'm running into problems with installing nscrub.

While, i had made it start succesfully, it has stopped working....

I have updated and removed/reinstalled pfring/dkms.

Thank you,

Spiros


Dmesg:

[    5.914450] i40e 0000:03:00.0 ens160: NIC Link is Up 10 Gbps Full
Duplex, Flow Control: None
[    5.914610] 8021q: adding VLAN 0 to HW filter on device ens160
[    5.914683] i40e 0000:03:00.0 ens160: adding 3c:fd:fe:18:0c:e0 vid=0
[    5.920257] vmxnet3 0000:0b:00.0 ens192: intr type 3, mode 0, 5
vectors allocated
[    5.920647] vmxnet3 0000:0b:00.0 ens192: NIC Link is Up 10000 Mbps
[    5.920753] 8021q: adding VLAN 0 to HW filter on device ens192
[    5.928329] cgroup: new mount options do not match the existing
superblock, will be ignored
[    5.976789] NET: Registered protocol family 40
[    8.401998] floppy0: no floppy controllers found
[    8.514589] pf_ring: module verification failed: signature and/or
required key missing - tainting kernel
[    8.515040] [PF_RING] Welcome to PF_RING 7.1.0 ($Revision:
dev:a16ab9b0be7cd806c6be6c4bebbffc843b1c0751$)
               (C) 2004-17 ntop.org
[    8.515042] [PF_RING] Min # ring slots 4096
[    8.515043] [PF_RING] Slot version     16
[    8.515043] [PF_RING] Capture TX       Yes [RX+TX]
[    8.515044] [PF_RING] IP Defragment    No
[    8.515054] [PF_RING] registered /proc/net/pf_ring/
[    8.515055] NET: Registered protocol family 27
[    8.515062] [PF_RING] Initialized correctly
[    8.540319] dca service started, version 1.12.1
[   11.641688] [PF_RING] pfring_select_zc_dev:5703 ens160@0 mapping
failed or not a ZC device

Nscrub log:

25/Nov/2017 22:14:21 [main.cpp:102] Creating engine instance..
25/Nov/2017 22:14:21 [Redis.cpp:77] Successfully connected to Redis
127.0.0.1:6379@0
25/Nov/2017 22:14:21 [main.cpp:114] Registering REST server..
25/Nov/2017 22:14:21 [main.cpp:122] Starting engine..
25/Nov/2017 22:14:21 [nScrub.cpp:205] Welcome to nscrub x86_64
v.1.0.171125 (620) - (C) 2017 ntop.org
25/Nov/2017 22:14:21 [nScrub.cpp:222] System initialisation
25/Nov/2017 22:14:21 [nScrub.cpp:249] ERROR: Error reading device
zc:ens160 info (please make sure pf_ring.ko is loaded)
25/Nov/2017 22:14:21 [nScrub.cpp:473] System initialised

The following is an earlier log, where I had the folowing nscrub.conf
settings, with a VM of 4 cores:

# Processing thread(s) CPU core(s) affinity (column-separated list in
case of RSS)
--thread-affinity=0:1:2:3
# Time thread CPU core affinity
#--time-source-affinity=4
# Other threads affinity
#--other-affinity=4

nscrub was working though, but after some time it started producing the
following errors:

Nscrub log:

25/Nov/2017 21:49:49 [main.cpp:102] Creating engine instance..
25/Nov/2017 21:49:49 [Redis.cpp:77] Successfully connected to Redis
127.0.0.1:6379@0
25/Nov/2017 21:49:49 [main.cpp:114] Registering REST server..
25/Nov/2017 21:49:49 [main.cpp:122] Starting engine..
25/Nov/2017 21:49:49 [nScrub.cpp:205] Welcome to nscrub x86_64
v.1.0.171125 (620) - (C) 2017 ntop.org
25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core
4: errno=22
25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core
4: errno=22
25/Nov/2017 21:49:49 [nScrub.cpp:222] System initialisation
25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core
4: errno=22
25/Nov/2017 21:49:49 [nScrub.cpp:249] ERROR: Error reading device
zc:ens160 info (please make sure pf_ring.ko is loaded)
25/Nov/2017 21:49:49 [nScrub.cpp:473] System initialised


_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc
Re: nscrub installation [ In reply to ]
Hi Spiros,

Did you install i40e-zc and pfring-drivers-zc-dkms packages together with pfring and pfring-dkms?

What Linux distro are you running?

José


Em 25/11/2017 8:37 PM, Spiros Papageorgiou <papage@noc.ntua.gr> escreveu:
Hi all,

I'm running into problems with installing nscrub.

While, i had made it start succesfully, it has stopped working....

I have updated and removed/reinstalled pfring/dkms.

Thank you,

Spiros


Dmesg:

[ 5.914450] i40e 0000:03:00.0 ens160: NIC Link is Up 10 Gbps Full
Duplex, Flow Control: None
[ 5.914610] 8021q: adding VLAN 0 to HW filter on device ens160
[ 5.914683] i40e 0000:03:00.0 ens160: adding 3c:fd:fe:18:0c:e0 vid=0
[ 5.920257] vmxnet3 0000:0b:00.0 ens192: intr type 3, mode 0, 5
vectors allocated
[ 5.920647] vmxnet3 0000:0b:00.0 ens192: NIC Link is Up 10000 Mbps
[ 5.920753] 8021q: adding VLAN 0 to HW filter on device ens192
[ 5.928329] cgroup: new mount options do not match the existing
superblock, will be ignored
[ 5.976789] NET: Registered protocol family 40
[ 8.401998] floppy0: no floppy controllers found
[ 8.514589] pf_ring: module verification failed: signature and/or
required key missing - tainting kernel
[ 8.515040] [PF_RING] Welcome to PF_RING 7.1.0 ($Revision:
dev:a16ab9b0be7cd806c6be6c4bebbffc843b1c0751$)
(C) 2004-17 ntop.org
[ 8.515042] [PF_RING] Min # ring slots 4096
[ 8.515043] [PF_RING] Slot version 16
[ 8.515043] [PF_RING] Capture TX Yes [RX+TX]
[ 8.515044] [PF_RING] IP Defragment No
[ 8.515054] [PF_RING] registered /proc/net/pf_ring/
[ 8.515055] NET: Registered protocol family 27
[ 8.515062] [PF_RING] Initialized correctly
[ 8.540319] dca service started, version 1.12.1
[ 11.641688] [PF_RING] pfring_select_zc_dev:5703 ens160@0 mapping
failed or not a ZC device

Nscrub log:

25/Nov/2017 22:14:21 [main.cpp:102] Creating engine instance..
25/Nov/2017 22:14:21 [Redis.cpp:77] Successfully connected to Redis
127.0.0.1:6379@0
25/Nov/2017 22:14:21 [main.cpp:114] Registering REST server..
25/Nov/2017 22:14:21 [main.cpp:122] Starting engine..
25/Nov/2017 22:14:21 [nScrub.cpp:205] Welcome to nscrub x86_64
v.1.0.171125 (620) - (C) 2017 ntop.org
25/Nov/2017 22:14:21 [nScrub.cpp:222] System initialisation
25/Nov/2017 22:14:21 [nScrub.cpp:249] ERROR: Error reading device
zc:ens160 info (please make sure pf_ring.ko is loaded)
25/Nov/2017 22:14:21 [nScrub.cpp:473] System initialised

The following is an earlier log, where I had the folowing nscrub.conf
settings, with a VM of 4 cores:

# Processing thread(s) CPU core(s) affinity (column-separated list in
case of RSS)
--thread-affinity=0:1:2:3
# Time thread CPU core affinity
#--time-source-affinity=4
# Other threads affinity
#--other-affinity=4

nscrub was working though, but after some time it started producing the
following errors:

Nscrub log:

25/Nov/2017 21:49:49 [main.cpp:102] Creating engine instance..
25/Nov/2017 21:49:49 [Redis.cpp:77] Successfully connected to Redis
127.0.0.1:6379@0
25/Nov/2017 21:49:49 [main.cpp:114] Registering REST server..
25/Nov/2017 21:49:49 [main.cpp:122] Starting engine..
25/Nov/2017 21:49:49 [nScrub.cpp:205] Welcome to nscrub x86_64
v.1.0.171125 (620) - (C) 2017 ntop.org
25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core
4: errno=22
25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core
4: errno=22
25/Nov/2017 21:49:49 [nScrub.cpp:222] System initialisation
25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core
4: errno=22
25/Nov/2017 21:49:49 [nScrub.cpp:249] ERROR: Error reading device
zc:ens160 info (please make sure pf_ring.ko is loaded)
25/Nov/2017 21:49:49 [nScrub.cpp:473] System initialised


_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc
Re: nscrub installation [ In reply to ]
Hi Spiros
did you configure the i40e zc driver according to https://github.com/ntop/PF_RING/blob/dev/doc/README.apt_rpm_packages.md <https://github.com/ntop/PF_RING/blob/dev/doc/README.apt_rpm_packages.md> ?
Please provide cat /proc/net/pf_ring/dev/ens160/info

Best Regards
Alfredo

> On 25 Nov 2017, at 21:37, Spiros Papageorgiou <papage@noc.ntua.gr> wrote:
>
> Hi all,
>
> I'm running into problems with installing nscrub.
>
> While, i had made it start succesfully, it has stopped working....
>
> I have updated and removed/reinstalled pfring/dkms.
>
> Thank you,
>
> Spiros
>
>
> Dmesg:
>
> [ 5.914450] i40e 0000:03:00.0 ens160: NIC Link is Up 10 Gbps Full Duplex, Flow Control: None
> [ 5.914610] 8021q: adding VLAN 0 to HW filter on device ens160
> [ 5.914683] i40e 0000:03:00.0 ens160: adding 3c:fd:fe:18:0c:e0 vid=0
> [ 5.920257] vmxnet3 0000:0b:00.0 ens192: intr type 3, mode 0, 5 vectors allocated
> [ 5.920647] vmxnet3 0000:0b:00.0 ens192: NIC Link is Up 10000 Mbps
> [ 5.920753] 8021q: adding VLAN 0 to HW filter on device ens192
> [ 5.928329] cgroup: new mount options do not match the existing superblock, will be ignored
> [ 5.976789] NET: Registered protocol family 40
> [ 8.401998] floppy0: no floppy controllers found
> [ 8.514589] pf_ring: module verification failed: signature and/or required key missing - tainting kernel
> [ 8.515040] [PF_RING] Welcome to PF_RING 7.1.0 ($Revision: dev:a16ab9b0be7cd806c6be6c4bebbffc843b1c0751$)
> (C) 2004-17 ntop.org
> [ 8.515042] [PF_RING] Min # ring slots 4096
> [ 8.515043] [PF_RING] Slot version 16
> [ 8.515043] [PF_RING] Capture TX Yes [RX+TX]
> [ 8.515044] [PF_RING] IP Defragment No
> [ 8.515054] [PF_RING] registered /proc/net/pf_ring/
> [ 8.515055] NET: Registered protocol family 27
> [ 8.515062] [PF_RING] Initialized correctly
> [ 8.540319] dca service started, version 1.12.1
> [ 11.641688] [PF_RING] pfring_select_zc_dev:5703 ens160@0 mapping failed or not a ZC device
>
> Nscrub log:
>
> 25/Nov/2017 22:14:21 [main.cpp:102] Creating engine instance..
> 25/Nov/2017 22:14:21 [Redis.cpp:77] Successfully connected to Redis 127.0.0.1:6379@0
> 25/Nov/2017 22:14:21 [main.cpp:114] Registering REST server..
> 25/Nov/2017 22:14:21 [main.cpp:122] Starting engine..
> 25/Nov/2017 22:14:21 [nScrub.cpp:205] Welcome to nscrub x86_64 v.1.0.171125 (620) - (C) 2017 ntop.org
> 25/Nov/2017 22:14:21 [nScrub.cpp:222] System initialisation
> 25/Nov/2017 22:14:21 [nScrub.cpp:249] ERROR: Error reading device zc:ens160 info (please make sure pf_ring.ko is loaded)
> 25/Nov/2017 22:14:21 [nScrub.cpp:473] System initialised
>
> The following is an earlier log, where I had the folowing nscrub.conf settings, with a VM of 4 cores:
>
> # Processing thread(s) CPU core(s) affinity (column-separated list in case of RSS)
> --thread-affinity=0:1:2:3
> # Time thread CPU core affinity
> #--time-source-affinity=4
> # Other threads affinity
> #--other-affinity=4
>
> nscrub was working though, but after some time it started producing the following errors:
>
> Nscrub log:
>
> 25/Nov/2017 21:49:49 [main.cpp:102] Creating engine instance..
> 25/Nov/2017 21:49:49 [Redis.cpp:77] Successfully connected to Redis 127.0.0.1:6379@0
> 25/Nov/2017 21:49:49 [main.cpp:114] Registering REST server..
> 25/Nov/2017 21:49:49 [main.cpp:122] Starting engine..
> 25/Nov/2017 21:49:49 [nScrub.cpp:205] Welcome to nscrub x86_64 v.1.0.171125 (620) - (C) 2017 ntop.org
> 25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core 4: errno=22
> 25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core 4: errno=22
> 25/Nov/2017 21:49:49 [nScrub.cpp:222] System initialisation
> 25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to core 4: errno=22
> 25/Nov/2017 21:49:49 [nScrub.cpp:249] ERROR: Error reading device zc:ens160 info (please make sure pf_ring.ko is loaded)
> 25/Nov/2017 21:49:49 [nScrub.cpp:473] System initialised
>
>
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc
Re: nscrub installation [ In reply to ]
Hi all,

Problem solved! Thanx for your guidance:
It needed:
 touch /etc/pf_ring/forcestart


I had configured though, interfaces.conf:
MANAGEMENT_INTERFACES="ens192"
CAPTURE_INTERFACES="ens160"

For reference:
I am on LTS16, and I have upgraded it to date.

I have these installed:
pfring/unknown,now 7.1.0-1566 amd64 [installed]
pfring-dkms/unknown,now 7.1.0 all [installed]
pfring-drivers-zc-dkms/unknown,now 1.3 all [installed]
i40e-zc-dkms/unknown,now 2.3.6.1566 all [installed]

root@nscrub:/etc# ls -lR pf_ring/
pf_ring/:
total 16
-rw-r--r-- 1 root root   27 Nov  2 21:00 hugepages.conf  --> node=0
hugepagenumber=1024
-rw-r--r-- 1 root root   58 Nov  2 21:03 interfaces.conf  ->
CAPTURE_INTERFACES="ens160",MANAGEMENT_INTERFACES="ens192"
-rw-r--r-- 1 root root    0 Oct 24 14:59 pf_ring.conf
-rw-r--r-- 1 root root    0 Oct 24 14:59 pf_ring.start
drwxr-xr-x 7 root root 4096 Oct 24 14:59 zc

pf_ring/zc/i40e:
total 4
-rw-r--r-- 1 root root 8 Nov 25 22:12 i40e.conf   ---> RSS=4,4
-rw-r--r-- 1 root root 0 Nov  2 20:59 i40e.start

On 25/11/2017 10:37 ??, Spiros Papageorgiou wrote:
> Hi all,
>
> I'm running into problems with installing nscrub.
>
> While, i had made it start succesfully, it has stopped working....
>
> I have updated and removed/reinstalled pfring/dkms.
>
> Thank you,
>
> Spiros
>
>
> Dmesg:
>
> [    5.914450] i40e 0000:03:00.0 ens160: NIC Link is Up 10 Gbps Full
> Duplex, Flow Control: None
> [    5.914610] 8021q: adding VLAN 0 to HW filter on device ens160
> [    5.914683] i40e 0000:03:00.0 ens160: adding 3c:fd:fe:18:0c:e0 vid=0
> [    5.920257] vmxnet3 0000:0b:00.0 ens192: intr type 3, mode 0, 5
> vectors allocated
> [    5.920647] vmxnet3 0000:0b:00.0 ens192: NIC Link is Up 10000 Mbps
> [    5.920753] 8021q: adding VLAN 0 to HW filter on device ens192
> [    5.928329] cgroup: new mount options do not match the existing
> superblock, will be ignored
> [    5.976789] NET: Registered protocol family 40
> [    8.401998] floppy0: no floppy controllers found
> [    8.514589] pf_ring: module verification failed: signature and/or
> required key missing - tainting kernel
> [    8.515040] [PF_RING] Welcome to PF_RING 7.1.0 ($Revision:
> dev:a16ab9b0be7cd806c6be6c4bebbffc843b1c0751$)
>                (C) 2004-17 ntop.org
> [    8.515042] [PF_RING] Min # ring slots 4096
> [    8.515043] [PF_RING] Slot version     16
> [    8.515043] [PF_RING] Capture TX       Yes [RX+TX]
> [    8.515044] [PF_RING] IP Defragment    No
> [    8.515054] [PF_RING] registered /proc/net/pf_ring/
> [    8.515055] NET: Registered protocol family 27
> [    8.515062] [PF_RING] Initialized correctly
> [    8.540319] dca service started, version 1.12.1
> [   11.641688] [PF_RING] pfring_select_zc_dev:5703 ens160@0 mapping
> failed or not a ZC device
>
> Nscrub log:
>
> 25/Nov/2017 22:14:21 [main.cpp:102] Creating engine instance..
> 25/Nov/2017 22:14:21 [Redis.cpp:77] Successfully connected to Redis
> 127.0.0.1:6379@0
> 25/Nov/2017 22:14:21 [main.cpp:114] Registering REST server..
> 25/Nov/2017 22:14:21 [main.cpp:122] Starting engine..
> 25/Nov/2017 22:14:21 [nScrub.cpp:205] Welcome to nscrub x86_64
> v.1.0.171125 (620) - (C) 2017 ntop.org
> 25/Nov/2017 22:14:21 [nScrub.cpp:222] System initialisation
> 25/Nov/2017 22:14:21 [nScrub.cpp:249] ERROR: Error reading device
> zc:ens160 info (please make sure pf_ring.ko is loaded)
> 25/Nov/2017 22:14:21 [nScrub.cpp:473] System initialised
>
> The following is an earlier log, where I had the folowing nscrub.conf
> settings, with a VM of 4 cores:
>
> # Processing thread(s) CPU core(s) affinity (column-separated list in
> case of RSS)
> --thread-affinity=0:1:2:3
> # Time thread CPU core affinity
> #--time-source-affinity=4
> # Other threads affinity
> #--other-affinity=4
>
> nscrub was working though, but after some time it started producing
> the following errors:
>
> Nscrub log:
>
> 25/Nov/2017 21:49:49 [main.cpp:102] Creating engine instance..
> 25/Nov/2017 21:49:49 [Redis.cpp:77] Successfully connected to Redis
> 127.0.0.1:6379@0
> 25/Nov/2017 21:49:49 [main.cpp:114] Registering REST server..
> 25/Nov/2017 21:49:49 [main.cpp:122] Starting engine..
> 25/Nov/2017 21:49:49 [nScrub.cpp:205] Welcome to nscrub x86_64
> v.1.0.171125 (620) - (C) 2017 ntop.org
> 25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to
> core 4: errno=22
> 25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to
> core 4: errno=22
> 25/Nov/2017 21:49:49 [nScrub.cpp:222] System initialisation
> 25/Nov/2017 21:49:49 [Utils.cpp:244] ERROR: Error while binding to
> core 4: errno=22
> 25/Nov/2017 21:49:49 [nScrub.cpp:249] ERROR: Error reading device
> zc:ens160 info (please make sure pf_ring.ko is loaded)
> 25/Nov/2017 21:49:49 [nScrub.cpp:473] System initialised
>
>

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc