Mailing List Archive

Google and our mailing lists
Our mailing list archive currently seems to be only indexed up to January
by Google, which, if I remember correctly, is the same time Google
temporarily stopped indexing Wikipedia articles due to a robots.txt
mishap.

Would it be possible to change the robots.txt so that our mailing lists
archives are fully indexed again? Since mailman itself has no search
feature, having them on Google would help a lot in locating past threads.
Of course, Hfastedge announced some time ago that he would look into a
search engine patch for mailman, that would also be neat.

Regards,

Erik
Re: Google and our mailing lists [ In reply to ]
Je Vendredo 23 Majo 2003 07:22, Erik Moeller skribis:
> Our mailing list archive currently seems to be only indexed up to
> January by Google, which, if I remember correctly, is the same time
> Google temporarily stopped indexing Wikipedia articles due to a
> robots.txt mishap.
>
> Would it be possible to change the robots.txt so that our mailing
> lists archives are fully indexed again?

No, since our robots.txt doesn't forbid it. Nor would that mishap have
directly prevented those directories (in /pipermail and /mailman, which
do not being with /w) from being indexed and spidered.

-- brion vibber (brion @ pobox.com)