Mailing List Archive

On Wed, Apr 12, 2000 at 09:49:29AM -0400, Kevin Dangoor wrote:
> I'm curious about this... Zope.org has a fair number of users (on the
> order of thousands), right? And each of these users has a folder in Members,
> right? Isn't the number of folders under Members getting to the point where
> performance will suffer because of the number of objects contained in there
> and the way the hash of objects is stored?
>
> I'm just curious of Zope.org is still using a "standard" folder/object
> manager for the members, or if it's using BTreeFolder or some other
> experimental thing...

We are having problems with the approach, it is one of the reasons that the
current Members roster (http://www.zope.org/Members/) states that is is
offline for maintanance.

I have a solution worked out for it, but no time currently to implement it (I
am not working at all until next week Wednesday). My previsous solution
involved using a _v_ variable for caching the generated data, but with 7
threads people hit threads as yet without the cache for this to have any
workable effect. I now plan to use a cache on the filesystem for this.

In our case, using a BTreeFolder wouldn't solve the problems either, as we
need to list data from all Member Folders (publicly visible or not) and all
User objects (last login for activity metrics). We still'd be waking up
12000+ objects.

--
Martijn Pieters
| Software Engineer mailto:mj@digicool.com
| Digital Creations http://www.digicool.com/
| Creators of Zope http://www.zope.org/
| The Open Source Web Application Server
---------------------------------------------

----- Original Message -----
From: "Martijn Pieters" <mj@digicool.com>
To: "Kevin Dangoor" <kid@kendermedia.com>
Cc: <zope-ptk@zope.org>
Sent: Wednesday, April 12, 2000 9:59 AM
Subject: Re: [Zope-PTK] large number of users, how does Zope.org do it?


> In our case, using a BTreeFolder wouldn't solve the problems either, as we
> need to list data from all Member Folders (publicly visible or not) and
all
> User objects (last login for activity metrics). We still'd be waking up
> 12000+ objects.

Couldn't you use ZCatalog for this? That way you're only waking up the
catalog metadata for the roster. Or is it that when you say "need to list
data from all Member Folders" you're talking about the documents, products,
etc that live within the Member folder?

I posed the original question because I was curious about the performance of
simply traversing to /Members/tazzzzz/kmnn, for example... I can certainly
see how there would be performance issues if you're ever trying to get data
from all of the objects in all of the member folders...

Kevin