Well, from my June crawl:
---------- begin include file -------------
CyberZine.org : Apache/0.6.4
WWW.Stars.com : Apache/0.6.2
WWW.ThoughtPort.COM : Apache/0.6.4
Webcrawler.cs.washington.edu : Apache/0.6.4b
ambook.org : Apache/0.6.4
arachnid.cm.cf.ac.uk : Apache/0.6.3
autan.enst.fr : Apache/0.6.4
ayup.res.wpi.edu : Apache/0.6.4b
biz.uoregon.edu : Apache/0.6.2
bong.com : Apache/0.7.3k
caesar.gse.rmit.edu.au : Apache/0.6.2
cair.kaist.ac.kr : Apache/0.6.4b
calweb.calweb.com : Apache/0.6.2
clever.net : Apache/0.6.4b
computerworks.clever.net : Apache/0.6.4b
connectus.com : Apache/0.6.5
cyberzine.org : Apache/0.6.4
dns.city-net.com : Apache/0.6.2
drasnia.it.com.au : Apache/0.6.2-DT
execpc.com : Apache/0.6.4
fohnix.metronet.com : Apache/0.6.2
free.isdn.uiuc.edu : Apache/0.6.2
ftp.fwi.uva.nl : Apache/0.6.2
gd.tuwien.ac.at : Apache/0.6.4b
gink.fentonnet.com : Apache/0.6.5
gnet.together.org : Apache/0.6.2
gpg.com : Apache/0.6.5
grad.csee.usf.edu : Apache/0.6.5
guru.med.cornell.edu : Apache/0.7.3h
haven.uniserve.com : Apache/0.6.4
ibd.ar.com : Apache/0.6.4
ice-www.larc.nasa.gov : Apache/0.6.4b
inorganic5.chem.ufl.edu : Apache/0.6.2
iquest.com : Apache/0.6.2
iuinfo.tuwien.ac.at : Apache/0.6.4b
kettle.magna.com.au : Apache/0.6.2
lib-www.ucr.edu : Apache/0.6.4b
links.tne.net : Apache/0.6.5
magna.com.au : Apache/0.6.2
marvin.macc.wisc.edu : Apache/0.6.4b
maui.net : Apache/0.6.4
meawx1.nrrc.ncsu.edu : Apache/0.7
mithral.iit.edu : Apache/0.6.4b
mits.mdata.fi : Apache/0.6.4b
movie-net.chi.il.us : Apache/0.6.2
muse.bio.cornell.edu : Apache/0.6.5
neuromancer.ucr.edu : Apache/0.6.4b
none.coolware.com : Apache/0.6.2
nswt.tuwien.ac.at : Apache/0.6.4b
oceania.org : Apache/0.6.4b
onyx.pvcc.cc.va.us : Apache/0.6.5
pharmacy.isu.edu : Apache/0.6.4b
public-www.pi.se : Apache/0.6.4b
pubweb.acns.nwu.edu : Apache/0.6.2
quake.net : Apache/0.6.4b
quiknet.com : Apache/0.6.5
random.chem.psu.edu : Apache/0.6.4b
reg.webcrawler.com : Apache/0.6.4b
saatel.shiny.it : Apache/0.6.2
scilib.ucsd.edu : Apache/0.6.4b
sdcc13.ucsd.edu : Apache/0.6.4b
sdcc3.ucsd.edu : Apache/0.6.4b
sehplib.ucsd.edu : Apache/0.6.4b
shaman.dds.nl : Apache/0.6.2
speed1.speed.net : Apache/0.6.4b
synapse-group.com : Apache/0.6.2
tamos.gmu.edu : Apache/0.6.4
tangler.usc.edu : Apache/0.6.2
tbone.biol.scarolina.edu : Apache/0.6.5
tinny.eis.net.au : Apache/0.6.4b
together.net : Apache/0.6.5
ultraviolet.com : Apache/0.7.2h
ux.accesscom.net : Apache/0.6.2
voyager.cns.ohiou.edu : Apache/0.6.4b
vrml.wired.com : Apache/0.7.2h
w3.north.net : Apache/0.6.3
warp.eecs.berkeley.edu : Apache/0.6.5
wcl-rs.bham.ac.uk : Apache/0.6.4
web.pst-elba.it : Apache/0.6.4b
webcrawler.com : Apache/0.6.4b
webcrawler.cs.washington.edu : Apache/0.6.4b
www-genome.wi.mit.edu : Apache/0.6.2
www-stud.enst.fr : Apache/0.6.5
www.CdnAir.ca : Apache/0.6.5
www.ThoughtPort.com : Apache/0.6.4
www.aa.net : Apache/0.6.2
www.abm.si : Apache/0.6.4
www.accesscom.net : Apache/0.6.2
www.aescon.com : Apache/0.6.4b
www.ai.mit.edu : Apache/0.6.4
www.ambook.org : Apache/0.6.4
www.artcom.de : Apache/0.6.2
www.atom.co.jp : Apache/0.6.4b
www.aurora.net : Apache/0.6.4b
www.austinre.com : Apache/0.6.5
www.baltimore.com : Apache/0.6.2
www.baynet.com : Apache/0.6.4b
www.belganet.be : Apache/0.6.4b
www.belize.com : Apache/0.6.2
www.bitstream.net : Apache/0.6.5
www.blarg.com : Apache/0.6.4b
www.bnt.com : Apache/0.6.2
www.c2.org : Apache/0.6.2
www.calweb.com : Apache/0.6.2
www.cbs.dk : Apache/0.6.4b
www.cdnair.ca : Apache/0.6.5
www.charm.net : Apache/0.6.2
www.cisnet.com : Apache/0.6.5
www.cleanair.com : Apache/0.6.2
www.cm.cf.ac.uk : Apache/0.7.2h
www.cme.com : Apache/0.6.2
www.commerce.com : Apache/0.6.4
www.connectus.com : Apache/0.6.2
www.cs.ruu.nl : Apache/0.6.4b
www.csee.usf.edu : Apache/0.6.5
www.cu.soltec.com : Apache/0.6.4b
www.cyberzine.org : Apache/0.6.4
www.datatext.co.uk : Apache/0.6.4b
www.dds.nl : Apache/0.6.2
www.demon.co.uk : Apache/0.6.3
www.demon.net : Apache/0.6.3
www.dircon.co.uk : Apache/0.6.4b
www.disaster.com : Apache/0.6.4b
www.doubleclickd.com : Apache/0.6.2
www.earthcom.com : Apache/0.6.2
www.eccnet.com : Apache/0.6.5
www.eia.brad.ac.uk : Apache/0.5.1
www.eit.com : Apache/0.6.2
www.elmail.co.uk : Apache/0.6.2
www.enst.fr : Apache/0.6.2
www.eurysis.com : Apache/0.6.4b
www.execpc.com : Apache/0.6.4
www.expoguide.com : Apache/0.6.4b
www.fednews.com : Apache/0.6.5
www.fentonnet.com : Apache/0.6.5
www.firstnight.org : Apache/0.6.2
www.fmmo.ca : Apache/0.6.4b
www.fni.com : Apache/0.6.5
www.foresight.co.uk : Apache/0.6.3
www.fwi.uva.nl : Apache/0.6.2
www.galcit.caltech.edu : Apache/0.6.4
www.ganet.net : Apache/0.6.4b
www.gem.co.za : Apache/0.6.1
www.gemini.co.uk : Apache/0.6.2
www.globalone.net : Apache/0.6.4b
www.godiscs.co.uk : Apache/0.6.3
www.gruntal.com : Apache/0.6.2
www.gse.rmit.edu.au : Apache/0.6.2
www.he.tdl.com : Apache/0.6.4b
www.hoovers.com : Apache/0.6.5
www.hotwired.com : Apache/0.6.1 - HotWired Mix
www.hyperreal.com : Apache/0.7.2h
www.iagi.net : Apache/0.6.4b
www.ianet.net : Apache/0.6.4b
www.ibmpcug.co.uk : Apache/0.6.4b
www.idt.unit.no : Apache/0.6.2
www.iinet.com.au : Apache/0.6.4b
www.illumination.co.uk : Apache/0.6.2
www.indra.com : Apache/0.6.2
www.inetnebr.com : Apache/0.7.2f
www.informatik.tu-muenchen.de : Apache/0.6.3 pl1
www.intbc.com : Apache/0.6.2
www.intelli.com : Apache/0.6.2
www.interaccess.com : Apache/0.6.2
www.interactive.net : Apache/0.7.2j
www.internex.net : Apache/0.6.4
www.iquest.com : Apache/0.6.2
www.israel.org : Apache/0.6.4b
www.itis.com : Apache/0.6.4b
www.kciLink.com : Apache/0.6.4b
www.kcilink.com : Apache/0.6.4b
www.kiosk.net : Apache/0.6.4
www.kuwait.net : Apache/0.6.4b
www.lenox.com : Apache/0.6.4b
www.leo.org : Apache/0.6.3 pl1
www.lib.ox.ac.uk : Apache/0.6.4
www.lights.com : Apache/0.6.5
www.magna.com.au : Apache/0.6.2
www.mainstream.nl : Apache/0.6.2 (XS4ALL)
www.maui.net : Apache/0.6.4
www.mediabridge.com : Apache/0.6.2
www.metronet.com : Apache/0.6.2
www.mfactory.com : Apache/0.6.4b
www.mica.edu : Apache/0.6.2
www.mpc.org : Apache/0.6.2
www.mtjeff.com : Apache/0.6.5
www.musicbase.co.uk : Apache/0.6.2
www.nabet.cwa.local41.org : Apache/0.6.2
www.net.org : Apache/0.6.4
www.netaxis.com : Apache/0.6.5
www.netgen.com : Apache/0.6.4b
www.nicoh.com : Apache/0.6.2
www.ntf.ca : Apache/0.6.5
www.nucleus.com : Apache/0.6.4b
www.nyweb.com : Apache/0.6.5
www.organic.com : Apache/0.6.4
www.panvera.com : Apache/0.6.4b
www.paranoia.com : Apache/0.6.4b
www.phasesep.co.uk : Apache/0.6.3
www.pi.se : Apache/0.6.4b
www.pk.edu.pl : Apache/0.6.4
www.presence.co.uk : Apache/0.6.4b
www.protocom.com : Apache/0.6.2
www.pst-elba.it : Apache/0.6.4b
www.public.com : Apache/0.6.4b
www.quake.net : Apache/0.6.4b
www.quality.co.uk : Apache/0.6.4b
www.quiknet.com : Apache/0.6.5
www.rbs.org : Apache/0.6.4b
www.realtime.net : Apache/0.6.5
www.res.enst.fr : Apache/0.6.2
www.rivendell.com : Apache/0.6.2
www.scar.toronto.edu : Apache/0.6.2
www.scar.utoronto.ca : Apache/0.6.2
www.scinetphotos.com : Apache/0.6.5
www.servtech.com : Apache/0.6.4b
www.speed.net : Apache/0.6.4b
www.ssc.com : Apache/0.6.4b
www.stars.com : Apache/0.6.2
www.state51.co.uk : Apache/0.6.3
www.stelcom.com : Apache/0.6.4b
www.stevens-tech.edu : Apache/0.6.5
www.strickland.com : Apache/0.6.4b
www.tach.net : Apache/0.6.4b
www.teamos2.org : Apache/0.6.5
www.teamworks.co.uk : Apache/0.6.2
www.tech.net : Apache/0.6.5
www.terminus.com : Apache/0.6.5
www.theta.com : Apache/0.6.2
www.thoughtport.com : Apache/0.6.4
www.threed-max.udac.se : Apache/0.6.4b
www.tias.com : Apache/0.6.2
www.tias.com : Apache/0.6.2
www.together.com : Apache/0.6.5
www.together.org : Apache/0.6.5
www.totalny.com : Apache/0.6.2
www.tribe.com : Apache/0.6.4
www.uce.com : Apache/0.6.4b
www.uci.agh.edu.pl : Apache/0.6.2
www.ugcs.caltech.edu : Apache/0.6.2
www.unantes.univ-nantes.fr : Apache/0.6.4b
www.unige.it. : Apache/0.6.4b
www.uniserve.com : Apache/0.6.4
www.univ-rennes1.fr : Apache/0.6.2
www.vfr.com : Apache/0.6.5
www.viabalt.ee : Apache/0.6.4
www.visa.com : Apache/0.6.4
www.vive.com : Apache/0.6.5
www.voiceofwomen.com : Apache/0.6.2
www.vyatka.su : Apache/0.6.4b
www.walgreens.com : Apache/0.6.2
www.walrus.com : Apache/0.6.4b
www.wcs-online.com : Apache/0.6.4b
www.webcrawler.com : Apache/0.6.4b
www.webscope.com : Apache/0.6.4b
www.westnet.com : Apache/0.6.2
www.wired.com : Apache/0.6.1 - HotWired Mix
www.wisdom.com : Apache/0.6.2
www.wspc.co.uk : Apache/0.6.3
www.wta.com : Apache/0.6.4b
www.xs4all.nl : Apache/0.6.2 (XS4ALL)
www2.msstate.edu : Apache/0.6.2
wwwetis.et.tudelft.nl : Apache/0.6.4
wwwhep.phys.soton.ac.uk : Apache/0.6.4b
xxx.lanl.gov : Apache/0.6.3
zebra.scarolina.edu : Apache/0.6.5
Apache/0.5.1 : 1 for 0.01%
Apache/0.6.1 : 1 for 0.01%
Apache/0.6.1 - HotWired Mix : 2 for 0.02%
Apache/0.6.2 : 79 for 0.75%
Apache/0.6.2 (XS4ALL) : 2 for 0.02%
Apache/0.6.2-DT : 1 for 0.01%
Apache/0.6.3 : 10 for 0.09%
Apache/0.6.3 pl1 : 2 for 0.02%
Apache/0.6.4 : 32 for 0.30%
Apache/0.6.4b : 87 for 0.82%
Apache/0.6.5 : 40 for 0.38%
Apache/0.7 : 1 for 0.01%
Apache/0.7.2f : 1 for 0.01%
Apache/0.7.2h : 4 for 0.04%
Apache/0.7.2j : 1 for 0.01%
Apache/0.7.3h : 1 for 0.01%
Apache/0.7.3k : 1 for 0.01%
--- end include ------
Thats about 250 sites out of the 10500 I hit. For comparison,
NetScape/NetSite: 350
CERN: 1900
CMSHTTPD: 20 (yeah, these are IBM mainframes)
GN: 110
HTTPS: 230
MacHTTP: 350
WN: 30
WebSTAR: 160
WinHttpd: 65
NCSA 1.3: 4200
NCSA 1.4: 1500
Unfortunetly, in my attempt to crawl last week, I had some fun. Something
about a drive filling up and my crawler hitting the same sight 500 times
in 2 minutes (to things explicitly disallowed in robots.txt, of all things)
I'm still trying to fix everything wrong that showed up in that failure.
Enjoy
Brandon
(No, I'm not likely to give you the list of people running 1.3 . . .
do you want the names of the 66 sites still running 1.0? how about the
401 still running 1.1?)
--
Brandon Long "I think, therefore I am Confused." - RAW
HTTPd/SDG/NCSA/UIUC "Here's a nickel, kid. Get yourself a better computer."
blong@uiuc.edu -"Dilbert" by Scott Adams 6-24-95
http://www.uiuc.edu/ph/www/blong Consider myself properly disclaimed.