Mailing List Archive

[lvs-users] Squid Proxy behind LVS not opening some pages
Hi,

I have LVS running on Centos 6.3 in a direct routing configuration using arptables to manage the VIPs.

It's working "nearly" perfectly.

I have noticed for a while that some pages don't open properly (they hang). I thought it was an issue with the websites each time but then started testing.

What I can see, is that if I access the proxy directly then the "problem" page opens instantly but if I access it via LVS (using the VIP) then it will just hang.

Doesn't make a difference if I am using an explicit or transparent proxy.

I have tried rr and lblc schedulers but to no avail.

Any ideas?

I noticed someone with similar issue http://serverfault.com/questions/188451/lvs-ipvs-load-balanced-squid-problems-with-some-sites and he ended up compiling a vanilla kernel. Don't want to go down that route if I don't have to.

Thanks

Daniel


_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
Send requests to lvs-users-request@LinuxVirtualServer.org
or go to http://lists.graemef.net/mailman/listinfo/lvs-users
Re: [lvs-users] Squid Proxy behind LVS not opening some pages [ In reply to ]
Try disabling generic-recieve-offload.

ethtool -K eth0 gro off

I also disabled large-recieve-offload, although I never spent much time
trying to figure out which was the 'right one', since it was causing
production problems.

ethtool -K eth0 lro off

My issue was on RHEL6.3, so pretty much the same environment as you,
although my boxes were using the igb driver (systems using e1000e on
older rev hardware didn't seem to exhibit the LVS problem).

On 12/10/12 6:25 PM, Daniel Niasoff wrote:
> Hi,
>
> I have LVS running on Centos 6.3 in a direct routing configuration using arptables to manage the VIPs.
>
> It's working "nearly" perfectly.
>
> I have noticed for a while that some pages don't open properly (they hang). I thought it was an issue with the websites each time but then started testing.
>
> What I can see, is that if I access the proxy directly then the "problem" page opens instantly but if I access it via LVS (using the VIP) then it will just hang.
>
> Doesn't make a difference if I am using an explicit or transparent proxy.
>
> I have tried rr and lblc schedulers but to no avail.
>
> Any ideas?
>
> I noticed someone with similar issue http://serverfault.com/questions/188451/lvs-ipvs-load-balanced-squid-problems-with-some-sites and he ended up compiling a vanilla kernel. Don't want to go down that route if I don't have to.
>
> Thanks
>
> Daniel
>
>
> _______________________________________________
> Please read the documentation before posting - it's available at:
> http://www.linuxvirtualserver.org/
>
> LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
> Send requests to lvs-users-request@LinuxVirtualServer.org
> or go to http://lists.graemef.net/mailman/listinfo/lvs-users


_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
Send requests to lvs-users-request@LinuxVirtualServer.org
or go to http://lists.graemef.net/mailman/listinfo/lvs-users
Re: [lvs-users] Squid Proxy behind LVS not opening some pages [ In reply to ]
Hi David,

Compiled latest vanilla kernel and all is fine now.

Must be some Centos/Redhat customisation I guess.

Thanks for your help anyway

Daniel

-----Original Message-----
From: Daniel Niasoff
Sent: 11 December 2012 01:09
To: 'David Coulson'
Subject: RE: [lvs-users] Squid Proxy behind LVS not opening some pages

Hi David,

Thanks for your prompt response.

The LVS box is a Hyper-V virtual server and all offload settings are off.

#ethtool -k eth0
Offload parameters for eth0:
rx-checksumming: off
tx-checksumming: off
scatter-gather: off
tcp-segmentation-offload: off
udp-fragmentation-offload: off
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

Anything else I can try?

Thanks

Daniel
-----Original Message-----
From: David Coulson [mailto:david@davidcoulson.net]
Sent: 11 December 2012 00:58
To: LinuxVirtualServer.org users mailing list.
Cc: Daniel Niasoff
Subject: Re: [lvs-users] Squid Proxy behind LVS not opening some pages

Try disabling generic-recieve-offload.

ethtool -K eth0 gro off

I also disabled large-recieve-offload, although I never spent much time trying to figure out which was the 'right one', since it was causing production problems.

ethtool -K eth0 lro off

My issue was on RHEL6.3, so pretty much the same environment as you, although my boxes were using the igb driver (systems using e1000e on older rev hardware didn't seem to exhibit the LVS problem).

On 12/10/12 6:25 PM, Daniel Niasoff wrote:
> Hi,
>
> I have LVS running on Centos 6.3 in a direct routing configuration using arptables to manage the VIPs.
>
> It's working "nearly" perfectly.
>
> I have noticed for a while that some pages don't open properly (they hang). I thought it was an issue with the websites each time but then started testing.
>
> What I can see, is that if I access the proxy directly then the "problem" page opens instantly but if I access it via LVS (using the VIP) then it will just hang.
>
> Doesn't make a difference if I am using an explicit or transparent proxy.
>
> I have tried rr and lblc schedulers but to no avail.
>
> Any ideas?
>
> I noticed someone with similar issue http://serverfault.com/questions/188451/lvs-ipvs-load-balanced-squid-problems-with-some-sites and he ended up compiling a vanilla kernel. Don't want to go down that route if I don't have to.
>
> Thanks
>
> Daniel
>
>
> _______________________________________________
> Please read the documentation before posting - it's available at:
> http://www.linuxvirtualserver.org/
>
> LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
> Send requests to lvs-users-request@LinuxVirtualServer.org
> or go to http://lists.graemef.net/mailman/listinfo/lvs-users


_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
Send requests to lvs-users-request@LinuxVirtualServer.org
or go to http://lists.graemef.net/mailman/listinfo/lvs-users