Mailing List Archive

[lvs-users] softirq skew
Hello!

I'm experiencing strange softirq skew. Server process only UDP traffic, 4
cores, but utilized only 2.

# uname -a
Linux host02 4.19.69-1.el7.x86_64 #1 SMP Thu Aug 29 11:11:09 UTC 2019
x86_64 x86_64 x86_64 GNU/Linux

# mpstat -P ALL 1 10
Linux 4.19.69-1.el7.x86_64 (host02) 04/23/2020 _x86_64_ (4
CPU)

11:03:01 AM CPU %usr %nice %sys %iowait %irq %soft %steal
%guest %gnice %idle
11:03:02 AM all 0.77 0.00 1.02 0.00 0.00 14.03
0.00 0.00 0.00 84.18
11:03:02 AM 0 2.04 0.00 0.00 0.00 0.00 2.04
0.00 0.00 0.00 95.92
11:03:02 AM 1 0.00 0.00 1.04 0.00 0.00 0.00
0.00 0.00 0.00 98.96
11:03:02 AM 2 0.00 0.00 1.02 0.00 0.00 26.53
0.00 0.00 0.00 72.45
11:03:02 AM 3 0.00 0.00 1.01 0.00 0.00 26.26
0.00 0.00 0.00 72.73

# cat /proc/interrupts | grep eth0
56: 0 0 0 291671902 PCI-MSI 5767168-edge
eth0-rxtx-0
57: 3757 2778 277492047 216 PCI-MSI 5767169-edge
eth0-rxtx-1
58: 871 286983758 0 113 PCI-MSI 5767170-edge
eth0-rxtx-2
59: 260724548 0 2607 55 PCI-MSI 5767171-edge
eth0-rxtx-3
60: 0 0 0 0 PCI-MSI 5767172-edge
eth0-event-4

# ipvsadm -Ln
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
FWM 245623413 wlc
-> 10.15.193.31:0 Tunnel 1 0 160
FWM 1962555235 wlc
-> 10.15.194.164:0 Tunnel 1 0 164
FWM -1996239082 wlc
-> 10.15.194.45:0 Tunnel 1 0 159
FWM -627923214 wlc
-> 10.15.194.188:0 Tunnel 1 0 159
FWM 661347975 wlc
-> 10.15.194.46:0 Tunnel 1 0 157

Could someone help me, please?

--
Alexander Petrovsky
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
Send requests to lvs-users-request@LinuxVirtualServer.org
or go to http://lists.graemef.net/mailman/listinfo/lvs-users
Re: [lvs-users] softirq skew [ In reply to ]
Did you try to use the driver multi queue script to enable multiple RX?
(also don't forget to turn off the irq balance)

Here's a better explanation to something similar to yours
https://blog.cloudflare.com/how-to-receive-a-million-packets/



*Att,*
*Leandro Ribeiro Moreira*

* Blog <http://leandromoreira.com.br/>*



On Thu, Apr 23, 2020 at 8:10 AM Alexander Petrovsky <askjuise@gmail.com>
wrote:

> Hello!
>
> I'm experiencing strange softirq skew. Server process only UDP traffic, 4
> cores, but utilized only 2.
>
> # uname -a
> Linux host02 4.19.69-1.el7.x86_64 #1 SMP Thu Aug 29 11:11:09 UTC 2019
> x86_64 x86_64 x86_64 GNU/Linux
>
> # mpstat -P ALL 1 10
> Linux 4.19.69-1.el7.x86_64 (host02) 04/23/2020 _x86_64_ (4
> CPU)
>
> 11:03:01 AM CPU %usr %nice %sys %iowait %irq %soft %steal
> %guest %gnice %idle
> 11:03:02 AM all 0.77 0.00 1.02 0.00 0.00 14.03
> 0.00 0.00 0.00 84.18
> 11:03:02 AM 0 2.04 0.00 0.00 0.00 0.00 2.04
> 0.00 0.00 0.00 95.92
> 11:03:02 AM 1 0.00 0.00 1.04 0.00 0.00 0.00
> 0.00 0.00 0.00 98.96
> 11:03:02 AM 2 0.00 0.00 1.02 0.00 0.00 26.53
> 0.00 0.00 0.00 72.45
> 11:03:02 AM 3 0.00 0.00 1.01 0.00 0.00 26.26
> 0.00 0.00 0.00 72.73
>
> # cat /proc/interrupts | grep eth0
> 56: 0 0 0 291671902 PCI-MSI 5767168-edge
> eth0-rxtx-0
> 57: 3757 2778 277492047 216 PCI-MSI 5767169-edge
> eth0-rxtx-1
> 58: 871 286983758 0 113 PCI-MSI 5767170-edge
> eth0-rxtx-2
> 59: 260724548 0 2607 55 PCI-MSI 5767171-edge
> eth0-rxtx-3
> 60: 0 0 0 0 PCI-MSI 5767172-edge
> eth0-event-4
>
> # ipvsadm -Ln
> IP Virtual Server version 1.2.1 (size=4096)
> Prot LocalAddress:Port Scheduler Flags
> -> RemoteAddress:Port Forward Weight ActiveConn InActConn
> FWM 245623413 wlc
> -> 10.15.193.31:0 Tunnel 1 0 160
> FWM 1962555235 wlc
> -> 10.15.194.164:0 Tunnel 1 0 164
> FWM -1996239082 wlc
> -> 10.15.194.45:0 Tunnel 1 0 159
> FWM -627923214 wlc
> -> 10.15.194.188:0 Tunnel 1 0 159
> FWM 661347975 wlc
> -> 10.15.194.46:0 Tunnel 1 0 157
>
> Could someone help me, please?
>
> --
> Alexander Petrovsky
> _______________________________________________
> Please read the documentation before posting - it's available at:
> http://www.linuxvirtualserver.org/
>
> LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
> Send requests to lvs-users-request@LinuxVirtualServer.org
> or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
Send requests to lvs-users-request@LinuxVirtualServer.org
or go to http://lists.graemef.net/mailman/listinfo/lvs-users