On wikipedia-l, Chuck Smith wrote:
> I COMPLETELY disagree with this. Let the robots crawl
> everything. It's better that someone finds one of our
> Talk or User pages and cruises on over to our main
> site than to simply find a completely website!
I think search robots should be stopped from indexing the editing
pages. Google has already indexed this URL
http://www.wikipedia.com/wiki/Wikipedia:Help&action=edit
and I don't see the point in that. Look here for a list,
http://www.google.com/search?q=+site:www.wikipedia.com+editing+wikipedia
This can be stopped by inserting this in the HTML <head>:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
--
Lars Aronsson (lars@aronsson.se)
tel +46-70-7891609
http://aronsson.se/ http://elektrosmog.nu/ http://susning.nu/
> I COMPLETELY disagree with this. Let the robots crawl
> everything. It's better that someone finds one of our
> Talk or User pages and cruises on over to our main
> site than to simply find a completely website!
I think search robots should be stopped from indexing the editing
pages. Google has already indexed this URL
http://www.wikipedia.com/wiki/Wikipedia:Help&action=edit
and I don't see the point in that. Look here for a list,
http://www.google.com/search?q=+site:www.wikipedia.com+editing+wikipedia
This can be stopped by inserting this in the HTML <head>:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
--
Lars Aronsson (lars@aronsson.se)
tel +46-70-7891609
http://aronsson.se/ http://elektrosmog.nu/ http://susning.nu/