Mailing List Archive: cache backend using 10X the amount of space

cache backend using 10X the amount of space

Feb 5, 2007, 4:16 PM

Post #1 of 4 (682 views)

I was wonding if it's normal that varnish uses 10X the amount of space
for small 3Kb pages? It seems that the cache ends up using between
28-30Kb for each 3Kb webpage. I can understand there being some
overhead, but 10 times the size, seems a bit much.

A related question, when the cache backend storagefile reaches the
maximum size, the whole cache seems to get invalidated and the contents
gets lost, and needs re-priming. Are there any options for using LRU or
other cache algorithms for handling the maximum backend storage file size.
I haven't found anything in the documentation or the website related to
this issue.

Thanks

--
Alex

cache backend using 10X the amount of space [ In reply to ]

ff at partyticket

Feb 8, 2007, 9:20 AM

Post #2 of 4 (675 views)

Permalink

Someone please set the Reply-to header to
varnish-misc at projects.linpro.no for this list?

Alternatively I'd like a recommendation for a mailer that knows about
mailing lists and can add the header for me.

-------- Original Message --------
Subject: Re: cache backend using 10X the amount of space
Date: Wed, 7 Feb 2007 11:37:43 -0800
From: Alex Apke <aapke@krugle.com>
To: Flemming Frandsen <ff at partyticket.net>
References: <20070205231651.GA26813 at avon.geekhive.net>
<45C97FDA.5040606 at partyticket.net>

On Wed, Feb 07, 2007 at 08:29:30AM +0100, Flemming Frandsen wrote:
> Alex Apke wrote:
> >A related question, when the cache backend storagefile reaches the
> >maximum size,
>
> What did you set that size to?
>
At first, I set it to 20MB, then 200MB, and currently I am testing it
with 6GB. With 20 and 200, the backend seems to rollover. I haven't yet
filled all 6GB so I don't know if it will happen, but I assume it will.

Watching the varnishstat when this happens, all the numbers reset
to zero including cache hits, misses, etc...

I also noticed that when the stats reset and the cache invalidates
itself, a new child processes replaces the original child.

Note: I am using the precompiled rpms for RHEL4, which I assume are ok.

--
Alex

--
Regards Flemming Frandsen - YAPH - http://dion.swamp.dk

cache backend using 10X the amount of space [ In reply to ]

des at linpro

Feb 8, 2007, 9:28 AM

Post #3 of 4 (673 views)

Permalink

Flemming Frandsen <ff at partyticket.net> writes:
> Someone please set the Reply-to header to
> varnish-misc at projects.linpro.no for this list?

http://www.unicom.com/pw/reply-to-harmful.html

> Alternatively I'd like a recommendation for a mailer that knows about
> mailing lists and can add the header for me.

Check to see if your MUA has a feature called "wide reply" or "group
reply" or "followup", which replies to the sender *and* all recipients
of the original message.

DES
--
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no

cache backend using 10X the amount of space [ In reply to ]

des at linpro

Feb 23, 2007, 3:11 AM

Post #4 of 4 (674 views)

Permalink

Alex Apke <aapke at krugle.com> writes:
> A related question, when the cache backend storagefile reaches the
> maximum size, the whole cache seems to get invalidated and the contents
> gets lost, and needs re-priming.

Actually, when the cache fills up, the Varnish child process crashes
and gets restarted... It's a feature, not a bug :)

I promise this will be fixed in 2.0 (and possibly in 1.1 if we decide
to do a 1.1 release)

DES
--
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no