Mailing List Archive

multiple backend + apache bottleneck
Hello all ,

We are using zope/nuxeo cps with 8 zeo clients and I test varnish 1.3
in place of squid 2.6.
squid uses 8 zeo peers and if I've understood well varnish can have
"only one" host per backend.
is there is a way to load balance upon multiples hosts with varnish ?

Varnish is so fast that the bottleneck is now apache ( we are using
apache with MPM workers + mod_rewrite in front of our site ).
Performances are equals in that design with squid / varnish ( near 1000
r/s on a quadriprocessor)
Not really a varnish question but maybe you can give me an advice to
have a full profit of varnish.

jean-marc.
multiple backend + apache bottleneck [ In reply to ]
----- jean-marc pouchoulon <jean-marc.pouchoulon at ac-montpellier.fr> wrote:
> Hello all ,
> We are using zope/nuxeo cps with 8 zeo clients and I test varnish 1.3
> in place of squid 2.6.
> squid uses 8 zeo peers and if I've understood well varnish can have
> "only one" host per backend.
> is there is a way to load balance upon multiples hosts with varnish ?

There are multiple ways to achieve this, but nothing is built into varnish (yet atleast). But there are multiple solutions out there you could utilize, either proprietary appliances or software (Alteon/Radware/Cisco/Zeus XTM) or open source solutions. I would guess the latter is most interesting for you, and I have heard good things about perlbal [1]. It is used by a number of high profile, high load sites.

We are currently running a setup where the pool is divided like this:

Alteon LB
/ \
VarnishServer1 VarnishServer2
| |
Apache2+mod_php1 Apache2+mod_php2

This caters to multiple failure situations; whenever Apache1 goes down Varnish2+Apache2 will serve the load and vice versa. If Varnish1 or Varnish2 goes down, the Alteon will direct traffic straight at the relevant backend (through a backup server config setting), but with a lot less weight than the remaining VarnishServer.

Ideally we would like to build an even more efficient setup, but there are certain limitations of the LB Switch OS we are currently running that prevent this as of now.

The setup I described above is probably not suited to your application though, this was more of an elaboration on one way to setup loadbalancing with Varnish.


[1] http://www.danga.com/perlbal/

--
Denis Braekhus - Teknisk Ansvarlig ABC Startsiden AS
http://www.startsiden.no
multiple backend + apache bottleneck [ In reply to ]
Hi,

jean-marc pouchoulon skrev:
> We are using zope/nuxeo cps with 8 zeo clients and I test varnish 1.3
> in place of squid 2.6.
> squid uses 8 zeo peers and if I've understood well varnish can have
> "only one" host per backend.
> is there is a way to load balance upon multiples hosts with varnish ?

Do you have a load balancer of choice? You might want to check out pound.


Per.
multiple backend + apache bottleneck [ In reply to ]
>
> Do you have a load balancer of choice? You might want to check out pound.
>
I use now for two days. I will follow this with care:

cisco css (deflate compression ) + 2 varnish 1.0.3 + 2 apache
(mod_rewrite + mod_proxy_balance) + 8 zeo.

to avoid apache "bottleneck" ( now cisco css and network are the
"bottlenecks" ... deflate heavily uses css compression card)

I tried to use pound instead of apache balance but I met some problems
I didn't understand.

Thanks for all your answers.


jean-marc


"longue vie ? varnish"
>
> Per.
multiple backend + apache bottleneck [ In reply to ]
Hi,

On Thu, 2007-05-03 at 20:39 +0200, Per Andreas Buer wrote:
> Hi,
>
> jean-marc pouchoulon skrev:
> > We are using zope/nuxeo cps with 8 zeo clients and I test varnish 1.3
> > in place of squid 2.6.
> > squid uses 8 zeo peers and if I've understood well varnish can have
> > "only one" host per backend.
> > is there is a way to load balance upon multiples hosts with varnish ?
>
> Do you have a load balancer of choice? You might want to check out pound.

As a load balancer, you can also try perlbal.

Marco Ramos

>
>
> Per.
> _______________________________________________
> varnish-misc mailing list
> varnish-misc at projects.linpro.no
> http://projects.linpro.no/mailman/listinfo/varnish-misc
>