Mailing List Archive

Hi Derek
weird issue, just to make sure: did you update both pfring and n2disk from the repository at the same time?
please provide a few details:

1. n2disk command line (or configuration file)
2. cat /proc/net/pf_ring/dev/eth4/info
3. ls /proc/net/pf_ring after getting the error below

Thank you
Alfredo

> On 23 Sep 2016, at 21:02, Spransy, Derek <dsprans@emory.edu> wrote:
>
> Hello,
>
> Today I upgraded to n2disk 2.6.160917. I also started using ZC rather than DNA drivers. Everything is working as far as I can tell on the pf_ring side, and zcount can access the interface. However, n2disk is not loading:
>
> 23/Sep/2016 14:57:53 [n2disk.c:4808] Welcome to n2disk10g v.2.6.160917 (r4666) [SandyBridge]
> 23/Sep/2016 14:57:53 [n2disk.c:4835] Running on 2 node(s) system with 24 core(s). NUMA affinity set to node 1.
> 23/Sep/2016 14:57:53 [n2disk.c:4864] Using PF_RING for packet capture
> 23/Sep/2016 14:57:53 [n2disk.c:4893] Multithread support enabled
> 23/Sep/2016 14:57:53 [n2disk.c:5007] Dump files max size is set to 1024 MB
> 23/Sep/2016 14:57:53 [n2disk.c:5024] Buffer memory is set to 4 GB (x 4 pcap files)
> 23/Sep/2016 14:57:53 [n2disk.c:5059] Using directory /data1/captures for dump files
> 23/Sep/2016 14:57:53 [n2disk.c:5064] No sub-directories will be created
> 23/Sep/2016 14:57:53 [n2disk.c:5069] Up to 43000 files will be written before overwriting
> 23/Sep/2016 14:57:53 [n2disk.c:5079] Dump files max duration is set to 600 sec
> 23/Sep/2016 14:57:53 [n2disk.c:5095] Dumping data in 0.1 MB chunks
> 23/Sep/2016 14:57:53 [n2disk.c:5138] Index processing memory is set to 847 MB (x 4 index files)
> 23/Sep/2016 14:57:57 [n2disk.c:5328] Memory allocated successfully
> 23/Sep/2016 14:57:57 [n2disk.c:3452] Using packet timestamps from pf_ring
> 23/Sep/2016 14:57:57 [n2disk.c:3464] ERROR: Unable to open PF_RING device zc:eth4 [globals.ro.snaplen=1536]
> 23/Sep/2016 14:57:57 [n2disk.c:884] Caught termination signal -1...
> 23/Sep/2016 14:57:57 [n2disk.c:272] Changing shutdown stage to 1 [shutdown_started]
> 23/Sep/2016 14:57:57 [n2disk.c:5335] ERROR: Unable to initialize packet reader
> 23/Sep/2016 14:57:57 [n2disk.c:5336] ERROR: Has the pf_ring kernel module been loaded ?
> 23/Sep/2016 14:57:57 [n2disk.c:880] Caught termination signal -1... (ignored)
>
> PF_Ring Info:
>
> PF_RING Version : 6.4.1 (6.4.1-stable:149f0127086c6ff5ffac30ac866182d09205daad)
> Total rings : 0
>
> Standard (non ZC) Options
> Ring slots : 65534
> Slot version : 16
> Capture TX : Yes [RX+TX]
> IP Defragment : No
> Socket Mode : Standard
> Total plugins : 0
> Cluster Fragment Queue : 0
> Cluster Fragment Discard : 0
>
> Name: eth4
> Index: 25
> Address: 90:E2:BA:11:0C:34
> Polling Mode: NAPI/ZC
> Type: Ethernet
> Family: Intel ixgbe 82599
> Max # TX Queues: 1
> # Used RX Queues: 1
> Num RX Slots: 32768
> Num TX Slots: 32768
>
> lsmod |grep pf_ring
> pf_ring 691110 2
>
> Any ideas?
>
> Thanks
>
>
> This e-mail message (including any attachments) is for the sole use of
> the intended recipient(s) and may contain confidential and privileged
> information. If the reader of this message is not the intended
> recipient, you are hereby notified that any dissemination, distribution
> or copying of this message (including any attachments) is strictly
> prohibited.
>
> If you have received this message in error, please contact
> the sender by reply e-mail message and destroy all copies of the
> original message (including attachments).
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it <mailto:Ntop-misc@listgateway.unipi.it>
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>

Hi Alfredo,


I think I've narrowed down the issue to something my configuration file. If I just run simply:

sudo /usr/local/bin/n2disk10g -i zc:eth4 -o ./tmp


Then n2disk will open the ZC interface and capture data.


My config file is below. The only thing I've changed since the upgrade is to add a cluster-id for ZC (makes no difference in behavior with or without cluster-id):


-i zc:eth4

--cluster-id 99

--index

--dump-directory /data1/captures

--timeline-dir /data1/index

--max-file-len 1024

--buffer-len 4096

--max-num-files 43000

-P=/var/run/n2disk.pid

--event-log /var/log/n2disk.log

--reader-cpu-affinity 6

--writer-cpu-affinity 8

--compressor-cpu-affinity 10,11

--index-on-compressor-threads

--pcap-compression

--remove-ahead

--unprivileged-user n2disk

--verbose


cat /proc/net/pf_ring/dev/eth4/info

Name: eth4

Index: 25

Address: 90:E2:BA:11:0C:34

Polling Mode: NAPI/ZC

Type: Ethernet

Family: Intel ixgbe 82599

Max # TX Queues: 1

# Used RX Queues: 1

Num RX Slots: 32768

Num TX Slots: 32768


ls /proc/net/pf_ring/

dev info plugins_info stats

________________________________
From: ntop-misc-bounces@listgateway.unipi.it <ntop-misc-bounces@listgateway.unipi.it> on behalf of Alfredo Cardigliano <cardigliano@ntop.org>
Sent: Saturday, September 24, 2016 5:22 AM
To: ntop-misc@listgateway.unipi.it
Subject: Re: [Ntop-misc] Unable to start n2disk after upgrade

Hi Derek
weird issue, just to make sure: did you update both pfring and n2disk from the repository at the same time?
please provide a few details:

1. n2disk command line (or configuration file)
2. cat /proc/net/pf_ring/dev/eth4/info
3. ls /proc/net/pf_ring after getting the error below

Thank you
Alfredo

On 23 Sep 2016, at 21:02, Spransy, Derek <dsprans@emory.edu<mailto:dsprans@emory.edu>> wrote:

Hello,

Today I upgraded to n2disk 2.6.160917. I also started using ZC rather than DNA drivers. Everything is working as far as I can tell on the pf_ring side, and zcount can access the interface. However, n2disk is not loading:


23/Sep/2016 14:57:53 [n2disk.c:4808] Welcome to n2disk10g v.2.6.160917 (r4666) [SandyBridge]
23/Sep/2016 14:57:53 [n2disk.c:4835] Running on 2 node(s) system with 24 core(s). NUMA affinity set to node 1.
23/Sep/2016 14:57:53 [n2disk.c:4864] Using PF_RING for packet capture
23/Sep/2016 14:57:53 [n2disk.c:4893] Multithread support enabled
23/Sep/2016 14:57:53 [n2disk.c:5007] Dump files max size is set to 1024 MB
23/Sep/2016 14:57:53 [n2disk.c:5024] Buffer memory is set to 4 GB (x 4 pcap files)
23/Sep/2016 14:57:53 [n2disk.c:5059] Using directory /data1/captures for dump files
23/Sep/2016 14:57:53 [n2disk.c:5064] No sub-directories will be created
23/Sep/2016 14:57:53 [n2disk.c:5069] Up to 43000 files will be written before overwriting
23/Sep/2016 14:57:53 [n2disk.c:5079] Dump files max duration is set to 600 sec
23/Sep/2016 14:57:53 [n2disk.c:5095] Dumping data in 0.1 MB chunks
23/Sep/2016 14:57:53 [n2disk.c:5138] Index processing memory is set to 847 MB (x 4 index files)
23/Sep/2016 14:57:57 [n2disk.c:5328] Memory allocated successfully
23/Sep/2016 14:57:57 [n2disk.c:3452] Using packet timestamps from pf_ring
23/Sep/2016 14:57:57 [n2disk.c:3464] ERROR: Unable to open PF_RING device zc:eth4 [globals.ro.snaplen=1536]
23/Sep/2016 14:57:57 [n2disk.c:884] Caught termination signal -1...
23/Sep/2016 14:57:57 [n2disk.c:272] Changing shutdown stage to 1 [shutdown_started]
23/Sep/2016 14:57:57 [n2disk.c:5335] ERROR: Unable to initialize packet reader
23/Sep/2016 14:57:57 [n2disk.c:5336] ERROR: Has the pf_ring kernel module been loaded ?
23/Sep/2016 14:57:57 [n2disk.c:880] Caught termination signal -1... (ignored)


PF_Ring Info:


PF_RING Version : 6.4.1 (6.4.1-stable:149f0127086c6ff5ffac30ac866182d09205daad)
Total rings : 0

Standard (non ZC) Options
Ring slots : 65534
Slot version : 16
Capture TX : Yes [RX+TX]
IP Defragment : No
Socket Mode : Standard
Total plugins : 0
Cluster Fragment Queue : 0
Cluster Fragment Discard : 0


Name: eth4
Index: 25
Address: 90:E2:BA:11:0C:34
Polling Mode: NAPI/ZC
Type: Ethernet
Family: Intel ixgbe 82599
Max # TX Queues: 1
# Used RX Queues: 1
Num RX Slots: 32768
Num TX Slots: 32768


lsmod |grep pf_ring
pf_ring 691110 2


Any ideas?

Thanks

________________________________

This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.

If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).
_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it<mailto:Ntop-misc@listgateway.unipi.it>
http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Also meant to add that I did upgrade n2disk and pfring at the same time from the stable repository.


________________________________
From: ntop-misc-bounces@listgateway.unipi.it <ntop-misc-bounces@listgateway.unipi.it> on behalf of Spransy, Derek <dsprans@emory.edu>
Sent: Saturday, September 24, 2016 9:45 AM
To: ntop-misc@listgateway.unipi.it
Subject: Re: [Ntop-misc] Unable to start n2disk after upgrade


Hi Alfredo,


I think I've narrowed down the issue to something my configuration file. If I just run simply:

sudo /usr/local/bin/n2disk10g -i zc:eth4 -o ./tmp


Then n2disk will open the ZC interface and capture data.


My config file is below. The only thing I've changed since the upgrade is to add a cluster-id for ZC (makes no difference in behavior with or without cluster-id):


-i zc:eth4

--cluster-id 99

--index

--dump-directory /data1/captures

--timeline-dir /data1/index

--max-file-len 1024

--buffer-len 4096

--max-num-files 43000

-P=/var/run/n2disk.pid

--event-log /var/log/n2disk.log

--reader-cpu-affinity 6

--writer-cpu-affinity 8

--compressor-cpu-affinity 10,11

--index-on-compressor-threads

--pcap-compression

--remove-ahead

--unprivileged-user n2disk

--verbose


cat /proc/net/pf_ring/dev/eth4/info

Name: eth4

Index: 25

Address: 90:E2:BA:11:0C:34

Polling Mode: NAPI/ZC

Type: Ethernet

Family: Intel ixgbe 82599

Max # TX Queues: 1

# Used RX Queues: 1

Num RX Slots: 32768

Num TX Slots: 32768


ls /proc/net/pf_ring/

dev info plugins_info stats

________________________________
From: ntop-misc-bounces@listgateway.unipi.it <ntop-misc-bounces@listgateway.unipi.it> on behalf of Alfredo Cardigliano <cardigliano@ntop.org>
Sent: Saturday, September 24, 2016 5:22 AM
To: ntop-misc@listgateway.unipi.it
Subject: Re: [Ntop-misc] Unable to start n2disk after upgrade

Hi Derek
weird issue, just to make sure: did you update both pfring and n2disk from the repository at the same time?
please provide a few details:

1. n2disk command line (or configuration file)
2. cat /proc/net/pf_ring/dev/eth4/info
3. ls /proc/net/pf_ring after getting the error below

Thank you
Alfredo

On 23 Sep 2016, at 21:02, Spransy, Derek <dsprans@emory.edu<mailto:dsprans@emory.edu>> wrote:

Hello,

Today I upgraded to n2disk 2.6.160917. I also started using ZC rather than DNA drivers. Everything is working as far as I can tell on the pf_ring side, and zcount can access the interface. However, n2disk is not loading:


23/Sep/2016 14:57:53 [n2disk.c:4808] Welcome to n2disk10g v.2.6.160917 (r4666) [SandyBridge]
23/Sep/2016 14:57:53 [n2disk.c:4835] Running on 2 node(s) system with 24 core(s). NUMA affinity set to node 1.
23/Sep/2016 14:57:53 [n2disk.c:4864] Using PF_RING for packet capture
23/Sep/2016 14:57:53 [n2disk.c:4893] Multithread support enabled
23/Sep/2016 14:57:53 [n2disk.c:5007] Dump files max size is set to 1024 MB
23/Sep/2016 14:57:53 [n2disk.c:5024] Buffer memory is set to 4 GB (x 4 pcap files)
23/Sep/2016 14:57:53 [n2disk.c:5059] Using directory /data1/captures for dump files
23/Sep/2016 14:57:53 [n2disk.c:5064] No sub-directories will be created
23/Sep/2016 14:57:53 [n2disk.c:5069] Up to 43000 files will be written before overwriting
23/Sep/2016 14:57:53 [n2disk.c:5079] Dump files max duration is set to 600 sec
23/Sep/2016 14:57:53 [n2disk.c:5095] Dumping data in 0.1 MB chunks
23/Sep/2016 14:57:53 [n2disk.c:5138] Index processing memory is set to 847 MB (x 4 index files)
23/Sep/2016 14:57:57 [n2disk.c:5328] Memory allocated successfully
23/Sep/2016 14:57:57 [n2disk.c:3452] Using packet timestamps from pf_ring
23/Sep/2016 14:57:57 [n2disk.c:3464] ERROR: Unable to open PF_RING device zc:eth4 [globals.ro.snaplen=1536]
23/Sep/2016 14:57:57 [n2disk.c:884] Caught termination signal -1...
23/Sep/2016 14:57:57 [n2disk.c:272] Changing shutdown stage to 1 [shutdown_started]
23/Sep/2016 14:57:57 [n2disk.c:5335] ERROR: Unable to initialize packet reader
23/Sep/2016 14:57:57 [n2disk.c:5336] ERROR: Has the pf_ring kernel module been loaded ?
23/Sep/2016 14:57:57 [n2disk.c:880] Caught termination signal -1... (ignored)


PF_Ring Info:


PF_RING Version : 6.4.1 (6.4.1-stable:149f0127086c6ff5ffac30ac866182d09205daad)
Total rings : 0

Standard (non ZC) Options
Ring slots : 65534
Slot version : 16
Capture TX : Yes [RX+TX]
IP Defragment : No
Socket Mode : Standard
Total plugins : 0
Cluster Fragment Queue : 0
Cluster Fragment Discard : 0


Name: eth4
Index: 25
Address: 90:E2:BA:11:0C:34
Polling Mode: NAPI/ZC
Type: Ethernet
Family: Intel ixgbe 82599
Max # TX Queues: 1
# Used RX Queues: 1
Num RX Slots: 32768
Num TX Slots: 32768


lsmod |grep pf_ring
pf_ring 691110 2


Any ideas?

Thanks

________________________________

This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.

If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).
_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it<mailto:Ntop-misc@listgateway.unipi.it>
http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Hi Derek
this has been fixed today, there was an issue parsing the configuration file,
we are building new stable packages right now, they will be available later today.
Thank you for reporting.

Alfredo

> On 24 Sep 2016, at 15:47, Spransy, Derek <dsprans@emory.edu> wrote:
>
> Also meant to add that I did upgrade n2disk and pfring at the same time from the stable repository.
>
>
> From: ntop-misc-bounces@listgateway.unipi.it <ntop-misc-bounces@listgateway.unipi.it> on behalf of Spransy, Derek <dsprans@emory.edu>
> Sent: Saturday, September 24, 2016 9:45 AM
> To: ntop-misc@listgateway.unipi.it
> Subject: Re: [Ntop-misc] Unable to start n2disk after upgrade
>
> Hi Alfredo,
>
> I think I've narrowed down the issue to something my configuration file. If I just run simply:
> sudo /usr/local/bin/n2disk10g -i zc:eth4 -o ./tmp
>
> Then n2disk will open the ZC interface and capture data.
>
> My config file is below. The only thing I've changed since the upgrade is to add a cluster-id for ZC (makes no difference in behavior with or without cluster-id):
>
> -i zc:eth4
> --cluster-id 99
> --index
> --dump-directory /data1/captures
> --timeline-dir /data1/index
> --max-file-len 1024
> --buffer-len 4096
> --max-num-files 43000
> -P=/var/run/n2disk.pid
> --event-log /var/log/n2disk.log
> --reader-cpu-affinity 6
> --writer-cpu-affinity 8
> --compressor-cpu-affinity 10,11
> --index-on-compressor-threads
> --pcap-compression
> --remove-ahead
> --unprivileged-user n2disk
> --verbose
>
> cat /proc/net/pf_ring/dev/eth4/info
> Name: eth4
> Index: 25
> Address: 90:E2:BA:11:0C:34
> Polling Mode: NAPI/ZC
> Type: Ethernet
> Family: Intel ixgbe 82599
> Max # TX Queues: 1
> # Used RX Queues: 1
> Num RX Slots: 32768
> Num TX Slots: 32768
>
> ls /proc/net/pf_ring/
> dev info plugins_info stats
>
> From: ntop-misc-bounces@listgateway.unipi.it <ntop-misc-bounces@listgateway.unipi.it> on behalf of Alfredo Cardigliano <cardigliano@ntop.org>
> Sent: Saturday, September 24, 2016 5:22 AM
> To: ntop-misc@listgateway.unipi.it
> Subject: Re: [Ntop-misc] Unable to start n2disk after upgrade
>
> Hi Derek
> weird issue, just to make sure: did you update both pfring and n2disk from the repository at the same time?
> please provide a few details:
>
> 1. n2disk command line (or configuration file)
> 2. cat /proc/net/pf_ring/dev/eth4/info
> 3. ls /proc/net/pf_ring after getting the error below
>
> Thank you
> Alfredo
>
>> On 23 Sep 2016, at 21:02, Spransy, Derek <dsprans@emory.edu <mailto:dsprans@emory.edu>> wrote:
>>
>> Hello,
>>
>> Today I upgraded to n2disk 2.6.160917. I also started using ZC rather than DNA drivers. Everything is working as far as I can tell on the pf_ring side, and zcount can access the interface. However, n2disk is not loading:
>>
>> 23/Sep/2016 14:57:53 [n2disk.c:4808] Welcome to n2disk10g v.2.6.160917 (r4666) [SandyBridge]
>> 23/Sep/2016 14:57:53 [n2disk.c:4835] Running on 2 node(s) system with 24 core(s). NUMA affinity set to node 1.
>> 23/Sep/2016 14:57:53 [n2disk.c:4864] Using PF_RING for packet capture
>> 23/Sep/2016 14:57:53 [n2disk.c:4893] Multithread support enabled
>> 23/Sep/2016 14:57:53 [n2disk.c:5007] Dump files max size is set to 1024 MB
>> 23/Sep/2016 14:57:53 [n2disk.c:5024] Buffer memory is set to 4 GB (x 4 pcap files)
>> 23/Sep/2016 14:57:53 [n2disk.c:5059] Using directory /data1/captures for dump files
>> 23/Sep/2016 14:57:53 [n2disk.c:5064] No sub-directories will be created
>> 23/Sep/2016 14:57:53 [n2disk.c:5069] Up to 43000 files will be written before overwriting
>> 23/Sep/2016 14:57:53 [n2disk.c:5079] Dump files max duration is set to 600 sec
>> 23/Sep/2016 14:57:53 [n2disk.c:5095] Dumping data in 0.1 MB chunks
>> 23/Sep/2016 14:57:53 [n2disk.c:5138] Index processing memory is set to 847 MB (x 4 index files)
>> 23/Sep/2016 14:57:57 [n2disk.c:5328] Memory allocated successfully
>> 23/Sep/2016 14:57:57 [n2disk.c:3452] Using packet timestamps from pf_ring
>> 23/Sep/2016 14:57:57 [n2disk.c:3464] ERROR: Unable to open PF_RING device zc:eth4 [globals.ro.snaplen=1536]
>> 23/Sep/2016 14:57:57 [n2disk.c:884] Caught termination signal -1...
>> 23/Sep/2016 14:57:57 [n2disk.c:272] Changing shutdown stage to 1 [shutdown_started]
>> 23/Sep/2016 14:57:57 [n2disk.c:5335] ERROR: Unable to initialize packet reader
>> 23/Sep/2016 14:57:57 [n2disk.c:5336] ERROR: Has the pf_ring kernel module been loaded ?
>> 23/Sep/2016 14:57:57 [n2disk.c:880] Caught termination signal -1... (ignored)
>>
>> PF_Ring Info:
>>
>> PF_RING Version : 6.4.1 (6.4.1-stable:149f0127086c6ff5ffac30ac866182d09205daad)
>> Total rings : 0
>>
>> Standard (non ZC) Options
>> Ring slots : 65534
>> Slot version : 16
>> Capture TX : Yes [RX+TX]
>> IP Defragment : No
>> Socket Mode : Standard
>> Total plugins : 0
>> Cluster Fragment Queue : 0
>> Cluster Fragment Discard : 0
>>
>> Name: eth4
>> Index: 25
>> Address: 90:E2:BA:11:0C:34
>> Polling Mode: NAPI/ZC
>> Type: Ethernet
>> Family: Intel ixgbe 82599
>> Max # TX Queues: 1
>> # Used RX Queues: 1
>> Num RX Slots: 32768
>> Num TX Slots: 32768
>>
>> lsmod |grep pf_ring
>> pf_ring 691110 2
>>
>> Any ideas?
>>
>> Thanks
>>
>>
>> This e-mail message (including any attachments) is for the sole use of
>> the intended recipient(s) and may contain confidential and privileged
>> information. If the reader of this message is not the intended
>> recipient, you are hereby notified that any dissemination, distribution
>> or copying of this message (including any attachments) is strictly
>> prohibited.
>>
>> If you have received this message in error, please contact
>> the sender by reply e-mail message and destroy all copies of the
>> original message (including attachments).
>> _______________________________________________
>> Ntop-misc mailing list
>> Ntop-misc@listgateway.unipi.it <mailto:Ntop-misc@listgateway.unipi.it>
>> http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc