Mailing List Archive

ban_limit parameter // Re: BAN - Memory consumption exploding under load
(discussion started on -misc, added -dev)

Hi,

On 03/11/16 11:04, Dridi Boukelmoune wrote:
> I was thinking (against the too-many-knobs trend) that maybe we should
> have some sort of ban_queue_limit parameter to avoid piling up too
> many bans.

Dridi and myself have briefly discussed this and at this point I think, yes, we
should have such a parameter.

It seems that the best option when exceeding the ban list maximum would probably
be to have (by the ban lurker) all objects removed which are untested at the
tail of the ban list.

This way, we would loose the long-tail bit of the cache, but not the hot objects
(because they will already have been tested up the ban list) while still
retaining the correct ban behavior (because all objects which are supposed to be
banned will be banned - implicitly).

The alternative to refuse additional bans appears problematic because
applications will rely on the ability to invalidate the cache for correctness.

Nils

_______________________________________________
varnish-dev mailing list
varnish-dev@varnish-cache.org
https://www.varnish-cache.org/lists/mailman/listinfo/varnish-dev
Re: ban_limit parameter // Re: BAN - Memory consumption exploding under load [ In reply to ]
> The alternative to refuse additional bans appears problematic because
> applications will rely on the ability to invalidate the cache for correctness.

To which I suggested that we should maybe have a means to clear a
cache completely without relying on a whole-encompassing ban, like a
varnish-cli command.

Users seeing failing bans could then make the decision to wipe the
cache while still maintaining uptime. Same thing when lookups start
taking seconds because of the number of bans to test, wiping the cache
can be a last-resort solution if turning the hypothetical knob down
isn't enough.

Dridi

_______________________________________________
varnish-dev mailing list
varnish-dev@varnish-cache.org
https://www.varnish-cache.org/lists/mailman/listinfo/varnish-dev
Re: ban_limit parameter // Re: BAN - Memory consumption exploding under load [ In reply to ]
https://github.com/varnishcache/varnish-cache/pull/2131

_______________________________________________
varnish-dev mailing list
varnish-dev@varnish-cache.org
https://www.varnish-cache.org/lists/mailman/listinfo/varnish-dev