Mailing List Archive

Hi Moshe
it really depends on several factors, including but not limited to traffic rate (pps), bandwidth, hw specs,
I need to know more about your traffic, hw configuration and what are you trying to do in order to help you.

Best Regards
Alfredo

> On 12 Jan 2017, at 06:00, Moshe Danielli <moshe.dani@walla.co.il> wrote:
>
> Hi Guys,
>
> What is the rule of thumb when determining the maximum amount of fan out interfaces (when using zfanout_ipc) ? Is it based on bandwidth, the hw specs or a combination of both ?
>
> Thanks in advance,
>
> Moshe
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Hi Alfredo,

I'm using the ixgbe driver with about 2.5M pps. What I'd like to do is clone the traffic so I can run multiple tcpdump instances, each with a different bpf, and store the output to a different pcap file, whose name is determined by the bpf in use. Is there a limit on the amount of virtual interfaces I can create in this scenario ? Thanks again ! Moshe

On Jan 12, 2017 16:50, Alfredo Cardigliano wrote:

Hi Moshe
it really depends on several factors, including but not limited to traffic rate (pps), bandwidth, hw specs,
I need to know more about your traffic, hw configuration and what are you trying to do in order to help you.

Best Regards
Alfredo

> On 12 Jan 2017, at 06:00, Moshe Danielli wrote:
>
> Hi Guys,
>
> What is the rule of thumb when determining the maximum amount of fan out interfaces (when using zfanout_ipc) ? Is it based on bandwidth, the hw specs or a combination of both ?
>
> Thanks in advance,
>
> Moshe
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Hi Moshe
there is a limit of 32 virtual interfaces when you use the fanout, because
of the API which is using a 32-bit mask to select the egress queues.

Alfredo

> On 12 Jan 2017, at 10:32, Moshe Danielli <moshe.dani@walla.co.il> wrote:
>
> Hi Alfredo,
>
> I'm using the ixgbe driver with about 2.5M pps.
>
> What I'd like to do is clone the traffic so I can run multiple tcpdump instances, each with a different bpf, and store the output to a different pcap file, whose name is determined by the bpf in use.
>
> Is there a limit on the amount of virtual interfaces I can create in this scenario ?
>
> Thanks again !
>
> Moshe
>
>
> On Jan 12, 2017 16:50, Alfredo Cardigliano wrote:
> Hi Moshe
> it really depends on several factors, including but not limited to traffic rate (pps), bandwidth, hw specs,
> I need to know more about your traffic, hw configuration and what are you trying to do in order to help you.
>
> Best Regards
> Alfredo
>
> > On 12 Jan 2017, at 06:00, Moshe Danielli wrote:
> >
> > Hi Guys,
> >
> > What is the rule of thumb when determining the maximum amount of fan out interfaces (when using zfanout_ipc) ? Is it based on bandwidth, the hw specs or a combination of both ?
> >
> > Thanks in advance,
> >
> > Moshe
> > _______________________________________________
> > Ntop-misc mailing list
> > Ntop-misc@listgateway.unipi.it <mailto:misc@listgateway.unipi.it>
> > http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>
>
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it <mailto:misc@listgateway.unipi.it>
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>
>
>
>
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Hi Again Alfredo,

What about performance considerations ? Is creating 32 interfaces creating substantial CPU / memory ohverhead, as opposed to creating only several virtual fanout interfaces ? I'm refering to the creation of the interfaces only... not consuming the traffic by other processes. Thanks again, Moshe

On Jan 12, 2017 20:50, Alfredo Cardigliano wrote:

Hi Moshethere is a limit of 32 virtual interfaces when you use the fanout, because of the API which is using a 32-bit mask to select the egress queues.
Alfredo

On 12 Jan 2017, at 10:32, Moshe Danielli <moshe.dani@walla.co.il> wrote:
Hi Alfredo,

I'm using the ixgbe driver with about 2.5M pps. What I'd like to do is clone the traffic so I can run multiple tcpdump instances, each with a different bpf, and store the output to a different pcap file, whose name is determined by the bpf in use. Is there a limit on the amount of virtual interfaces I can create in this scenario ? Thanks again ! Moshe

On Jan 12, 2017 16:50, Alfredo Cardigliano wrote:

Hi Moshe
it really depends on several factors, including but not limited to traffic rate (pps), bandwidth, hw specs,
I need to know more about your traffic, hw configuration and what are you trying to do in order to help you.

Best Regards
Alfredo

> On 12 Jan 2017, at 06:00, Moshe Danielli wrote:
>
> Hi Guys,
>
> What is the rule of thumb when determining the maximum amount of fan out interfaces (when using zfanout_ipc) ? Is it based on bandwidth, the hw specs or a combination of both ?
>
> Thanks in advance,
>
> Moshe
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Hi Moshe
2.5Mpps should not be a big deal even if you have many queues, just pay attention to dedicate one core to the fanout thread.
As of idle queues (with no consumers) they should not add any significant overhead until you use them.

Alfredo

> On 15 Jan 2017, at 13:47, Moshe Danielli <moshe.dani@walla.co.il> wrote:
>
> Hi Again Alfredo,
>
>
> What about performance considerations ?
>
> Is creating 32 interfaces creating substantial CPU / memory ohverhead, as opposed to creating only several virtual fanout interfaces ? I'm refering to the creation of the interfaces only... not consuming the traffic by other processes.
>
> Thanks again,
>
> Moshe
>
>
> On Jan 12, 2017 20:50, Alfredo Cardigliano wrote:
> Hi Moshe
> there is a limit of 32 virtual interfaces when you use the fanout, because
> of the API which is using a 32-bit mask to select the egress queues.
>
> Alfredo
>
>> On 12 Jan 2017, at 10:32, Moshe Danielli <moshe.dani@walla.co.il <mailto:moshe.dani@walla.co.il>> wrote:
>>
>> Hi Alfredo,
>>
>> I'm using the ixgbe driver with about 2.5M pps.
>> What I'd like to do is clone the traffic so I can run multiple tcpdump instances, each with a different bpf, and store the output to a different pcap file, whose name is determined by the bpf in use.
>> Is there a limit on the amount of virtual interfaces I can create in this scenario ?
>> Thanks again !
>> Moshe
>>
>> On Jan 12, 2017 16:50, Alfredo Cardigliano wrote:
>> Hi Moshe
>> it really depends on several factors, including but not limited to traffic rate (pps), bandwidth, hw specs,
>> I need to know more about your traffic, hw configuration and what are you trying to do in order to help you.
>>
>> Best Regards
>> Alfredo
>>
>> > On 12 Jan 2017, at 06:00, Moshe Danielli wrote:
>> >
>> > Hi Guys,
>> >
>> > What is the rule of thumb when determining the maximum amount of fan out interfaces (when using zfanout_ipc) ? Is it based on bandwidth, the hw specs or a combination of both ?
>> >
>> > Thanks in advance,
>> >
>> > Moshe
>> > _______________________________________________
>> > Ntop-misc mailing list
>> > Ntop-misc@listgateway.unipi.it <mailto:misc@listgateway.unipi.it>
>> > http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>
>>
>> _______________________________________________
>> Ntop-misc mailing list
>> Ntop-misc@listgateway.unipi.it <mailto:misc@listgateway.unipi.it>
>> http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>
>>
>>
>>
>> _______________________________________________
>> Ntop-misc mailing list
>> Ntop-misc@listgateway.unipi.it <mailto:Ntop-misc@listgateway.unipi.it>
>> http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>
>
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it <mailto:misc@listgateway.unipi.it>
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc <http://listgateway.unipi.it/mailman/listinfo/ntop-misc>
>
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc

Thank you Alfredo !

On Jan 15, 2017 16:07, Alfredo Cardigliano wrote:

Hi Moshe2.5Mpps should not be a big deal even if you have many queues, just pay attention to dedicate one core to the fanout thread.As of idle queues (with no consumers) they should not add any significant overhead until you use them.
Alfredo

On 15 Jan 2017, at 13:47, Moshe Danielli <moshe.dani@walla.co.il> wrote:
Hi Again Alfredo,

What about performance considerations ? Is creating 32 interfaces creating substantial CPU / memory ohverhead, as opposed to creating only several virtual fanout interfaces ? I'm refering to the creation of the interfaces only... not consuming the traffic by other processes. Thanks again, Moshe

On Jan 12, 2017 20:50, Alfredo Cardigliano wrote:

Hi Moshethere is a limit of 32 virtual interfaces when you use the fanout, because of the API which is using a 32-bit mask to select the egress queues.
Alfredo

On 12 Jan 2017, at 10:32, Moshe Danielli <moshe.dani@walla.co.il> wrote:
Hi Alfredo,

I'm using the ixgbe driver with about 2.5M pps. What I'd like to do is clone the traffic so I can run multiple tcpdump instances, each with a different bpf, and store the output to a different pcap file, whose name is determined by the bpf in use. Is there a limit on the amount of virtual interfaces I can create in this scenario ? Thanks again ! Moshe

On Jan 12, 2017 16:50, Alfredo Cardigliano wrote:

Hi Moshe
it really depends on several factors, including but not limited to traffic rate (pps), bandwidth, hw specs,
I need to know more about your traffic, hw configuration and what are you trying to do in order to help you.

Best Regards
Alfredo

> On 12 Jan 2017, at 06:00, Moshe Danielli wrote:
>
> Hi Guys,
>
> What is the rule of thumb when determining the maximum amount of fan out interfaces (when using zfanout_ipc) ? Is it based on bandwidth, the hw specs or a combination of both ?
>
> Thanks in advance,
>
> Moshe
> _______________________________________________
> Ntop-misc mailing list
> Ntop-misc@listgateway.unipi.it
> http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc

_______________________________________________
Ntop-misc mailing list
Ntop-misc@listgateway.unipi.it
http://listgateway.unipi.it/mailman/listinfo/ntop-misc"]http://listgateway.unipi.it/mailman/listinfo/ntop-misc