统计web服务器类型

tec_feng

　　现在做web开发肯定离不开web服务器。知道各大网站用的都是什么服务器吗？
　　今天我就怀着这样一个好奇心写了个搜索web服务器类型的工具，具体代码就不贴了。
程序和代码在这里
　　主要思路是：
　　向一个网站发送HTTP请求，收到HTTP回复后检测其头部Server的值。
　　为了实现批量获取，还需要指定一系列网站的URL。
　　为了偷懒，我就从一个网页开始遍历其中所有的网址，然后获取其服务器类型。
　　光有数据还不行，还要对数据进行分析。我的策略是只分析服务器大的种类，具体版本就忽略了，这样就可以使用linq进行按服务器类型分组、排序等待
　　
　　运行结果：
　　从www.hao123.com开始搜索，前三个用的最多的服务器是Apache(38.64%),nginx(21.36%),Microsoft IIS(17.27%).
　　然后还可以发现：Apache真的还有很多人用；尽管微软的IIS都有7.5的了，但6.0的IIS依旧还有很多在用。
　　下面是搜索到的服务器：


  


chexian.pingan.com:
wenku.baidu.com:lighttpd
www.hao123.com:lighttpd
hi.baidu.com:apache 1.1.26.0
www.baidu.com:BWS/1.0
top.baidu.com:Apache
dict.baidu.com:Apache
www.ifeng.com:DnionOS/1.0
www.sohu.com:Apache
www.cntv.cn:Apache
www.hunantv.com:nginx/0.6.35
www.gov.cn:Apache
www.people.com.cn:nginx
www.kaixin001.com:Apache
baike.baidu.com:Apache
www.google.com.hk:gws
utility.hao123.com:Apache
www.zhcw.com:Apache/2.0.63 (Unix) DAV/2
www.sina.com.cn:Apache/2.0.63 (Unix)
www.163.com:nginx
www.youku.com:bjwww
www.autohome.com.cn:Microsoft-IIS/6.0
www.renren.com:nginx/0.7.64
www.xinhuanet.com:Apache
www.eastmoney.com:nginx/0.8.36
www.51seer.com:WS CDN Server
www.ctrip.com:Microsoft-IIS/6.0
youa.baidu.com:Apache
www.58.com:Microsoft-IIS/6.0
www.rayli.com.cn:Apache
www.ganji.com:nginx/0.7.62
www.zhaopin.com:Apache/1.3.29 (Unix) mod_webapp/1.2.0-dev
www.anjuke.com:nginx
www.icbc.com.cn:Microsoft-IIS/6.0
10086.cn:Apache
house.sina.com.cn:Apache/2.0.63 (Unix)
www.pconline.com.cn:DnionOS/1.0
www.zol.com.cn:Apache
www.qq.com:nginx/0.6.39
www.chinahr.com:Microsoft-IIS/6.0
tl.changyou.com:Apache
www.bitauto.com:Microsoft-IIS/6.0
www.qunar.com:nginx/0.7.64
www.lafaso.com:nginx/0.7.61
www.justonline.cn:Apache/2.2.15 (Win32) PHP/5.2.8
www.moonbasa.com:DnionOS/1.0
union.360buy.com:jdws
www.baihe.com:Apache/2.0.59 (Unix)
huangguan.yijia.com:nginx/0.8.34
www.taobao.com:Apache
www.s.cn:nginx/51086858
video.sina.com.cn:nginx/0.5.35
www.lashou.com:Apache/2.2.15 (Unix) mod_ssl/2.2.15 OpenSSL/0.9.8e-fips-rhel5 PHP/5.3.2 DAV/2
www.qiyi.com:nginx
www.letv.com:nginx/0.7.65
jipiao.kuxun.cn:lighttpd
www.letao.com:Microsoft-IIS/6.0
www.m1905.com:nginx/0.7.61
www.elong.com:Microsoft-IIS/6.0
www.mbaobao.com:
www.funshion.com:lighttpd/1.4.22
www.17173.com:Apache
tv.sohu.com:Apache
www.4399.com:Microsoft-IIS/6.0
www.7k7k.com:Microsoft-IIS/6.0
my.91.com:Apache/2.2.6 (Unix)
zt.ztgame.com:DnionOS/1.0
news.sina.com.cn:Apache/2.0.63 (Unix)
dhsh.changyou.com:Apache
news.qq.com:nginx/0.6.39
military.china.com:nginx/0.7.63
mil.news.sina.com.cn:Apache/2.0.63 (Unix)
www.shumenol.com:
war.news.163.com:nginx
news.ifeng.com:DnionOS/1.0
news.sohu.com:Apache/1.3.37 (Unix) mod_gzip/1.3.26.1a
www.china.com.cn:Sun-ONE-Web-Server/6.1
www.warcraftchina.com:Apache
www.tiexue.net:Microsoft-IIS/6.0
www.mod.gov.cn:Apache
han.70yx.com:Microsoft-IIS/6.0
pv.7fgame.com:Microsoft-IIS/6.0
www.amazon.cn:Server
www.qq163.com:Microsoft-IIS/6.0
www.5173.com:Microsoft-IIS/6.0
www.1ting.com:
kok3.ztgame.com:DnionOS/1.0
mail.cn.yahoo.com:
www.aiting.com:Microsoft-IIS/6.0
www.kuwo.cn:nginx/0.6.34
mail.qq.com:TWS
www.qidian.com:Microsoft-IIS/6.0
mp3.baidu.com:apache 1.6.14.0
www.xxsy.net:Microsoft-IIS/6.0
mail.sina.com.cn:Apache/2.2.9 (FreeBSD) mod_ssl/2.2.9 OpenSSL/0.9.7e-p1 PHP/5.2.6 with Suhosin-Patch
home.woool.sdo.com:SNDA CDN Cache Server
act.dn.sdo.com:SNDA CDN Cache Server
www.readnovel.com:
www.jiayuan.com:nginx
email.163.com:Apache
www.126.com:Apache
www.xs8.cn:
www.51mole.com:nginx/CHINACACHE
hua.61.com:nginx/CHINACACHE
www.91wan.com:lighttpd/1.4.26
www.265g.com:Microsoft-IIS/6.0
www.jjwxc.net:Apache
www.3366.com:lighttpd/1.4.20
xiaoyou.qq.com:Apache
www.mop.com:dx136
finance.sina.com.cn:Apache
17roco.com:Apache
r.dangdang.com:nginx/0.6.37
finance.qq.com:nginx/0.6.39
www.hotmail.com:Microsoft-IIS/6.0
www.jrj.com.cn:
www.zhenai.com:Apache
business.sohu.com:SWS
www.pcpop.com:Microsoft-IIS/6.0
www.stockstar.com:nginx/0.7.59
www.tianya.cn:Microsoft-IIS/6.0
www.marry5.com:Apache
tieba.baidu.com:apache 2.7.18.0
www.onlinedown.net:Microsoft-IIS/6.0
www.skycn.com:Apache
www.cmbchina.com:
blog.sina.com.cn:nginx/0.7.62
www.51.com:Apache
blog.163.com:nginx
blog.sohu.com:nginx
www.abchina.com:Microsoft-IIS/7.5,M2
www.ccb.com:Apache
sports.sina.com.cn:Apache
t.sina.com.cn:Apache
sports.sohu.com:SWS
qzone.qq.com:Apache
sports.qq.com:nginx/0.6.39
nba.tom.com:nginx/0.6.32
sports.tom.com:Apache
tech.sina.com.cn:Apache
www.hoopchina.com:[SA: xifan hcw/web-12-10-53

　　


chexian.pingan.com
wenku.baidu.comlighttpd
www.hao123.comlighttpd
hi.baidu.comapache 1.1.26.0
www.baidu.comBWS/1.0
top.baidu.comApache
dict.baidu.comApache
www.ifeng.comDnionOS/1.0
www.sohu.comApache
www.cntv.cnApache
www.hunantv.comnginx/0.6.35
www.gov.cnApache
www.people.com.cnnginx
www.kaixin001.comApache
baike.baidu.comApache
www.google.com.hkgws
utility.hao123.comApache
www.zhcw.comApache/2.0.63 (Unix) DAV/2
www.sina.com.cnApache/2.0.63 (Unix)
www.163.comnginx
www.youku.combjwww
www.autohome.com.cnMicrosoft-IIS/6.0
www.renren.comnginx/0.7.64
www.xinhuanet.comApache
www.eastmoney.comnginx/0.8.36
www.51seer.comWS CDN Server
www.ctrip.comMicrosoft-IIS/6.0
youa.baidu.comApache
www.58.comMicrosoft-IIS/6.0
www.rayli.com.cnApache
www.ganji.comnginx/0.7.62
www.zhaopin.comApache/1.3.29 (Unix) mod_webapp/1.2.0-dev
www.anjuke.comnginx
www.icbc.com.cnMicrosoft-IIS/6.0
10086.cnApache
house.sina.com.cnApache/2.0.63 (Unix)
www.pconline.com.cnDnionOS/1.0
www.zol.com.cnApache
www.qq.comnginx/0.6.39
www.chinahr.comMicrosoft-IIS/6.0
tl.changyou.comApache
www.bitauto.comMicrosoft-IIS/6.0
www.qunar.comnginx/0.7.64
www.lafaso.comnginx/0.7.61
www.justonline.cnApache/2.2.15 (Win32) PHP/5.2.8
www.moonbasa.comDnionOS/1.0
union.360buy.comjdws
www.baihe.comApache/2.0.59 (Unix)
huangguan.yijia.comnginx/0.8.34
www.taobao.comApache
www.s.cnnginx/51086858
video.sina.com.cnnginx/0.5.35
www.lashou.comApache/2.2.15 (Unix) mod_ssl/2.2.15 OpenSSL/0.9.8e-fips-rhel5 PHP/5.3.2 DAV/2
www.qiyi.comnginx
www.letv.comnginx/0.7.65
jipiao.kuxun.cnlighttpd
www.letao.comMicrosoft-IIS/6.0
www.m1905.comnginx/0.7.61
www.elong.comMicrosoft-IIS/6.0
www.mbaobao.com
www.funshion.comlighttpd/1.4.22
www.17173.comApache
tv.sohu.comApache
www.4399.comMicrosoft-IIS/6.0
www.7k7k.comMicrosoft-IIS/6.0
my.91.comApache/2.2.6 (Unix)
zt.ztgame.comDnionOS/1.0
news.sina.com.cnApache/2.0.63 (Unix)
dhsh.changyou.comApache
news.qq.comnginx/0.6.39
military.china.comnginx/0.7.63
mil.news.sina.com.cnApache/2.0.63 (Unix)
www.shumenol.com
war.news.163.comnginx
news.ifeng.comDnionOS/1.0
news.sohu.comApache/1.3.37 (Unix) mod_gzip/1.3.26.1a
www.china.com.cnSun-ONE-Web-Server/6.1
www.warcraftchina.comApache
www.tiexue.netMicrosoft-IIS/6.0
www.mod.gov.cnApache
han.70yx.comMicrosoft-IIS/6.0
pv.7fgame.comMicrosoft-IIS/6.0
www.amazon.cnServer
www.qq163.comMicrosoft-IIS/6.0
www.5173.comMicrosoft-IIS/6.0
www.1ting.com
kok3.ztgame.comDnionOS/1.0
mail.cn.yahoo.com
www.aiting.comMicrosoft-IIS/6.0
www.kuwo.cnnginx/0.6.34
mail.qq.comTWS
www.qidian.comMicrosoft-IIS/6.0
mp3.baidu.comapache 1.6.14.0
www.xxsy.netMicrosoft-IIS/6.0
mail.sina.com.cnApache/2.2.9 (FreeBSD) mod_ssl/2.2.9 OpenSSL/0.9.7e-p1 PHP/5.2.6 with Suhosin-Patch
home.woool.sdo.comSNDA CDN Cache Server
act.dn.sdo.comSNDA CDN Cache Server
www.readnovel.com
www.jiayuan.comnginx
email.163.comApache
www.126.comApache
www.xs8.cn
www.51mole.comnginx/CHINACACHE
hua.61.comnginx/CHINACACHE
www.91wan.comlighttpd/1.4.26
www.265g.comMicrosoft-IIS/6.0
www.jjwxc.netApache
www.3366.comlighttpd/1.4.20
xiaoyou.qq.comApache
www.mop.comdx136
finance.sina.com.cnApache
17roco.comApache
r.dangdang.comnginx/0.6.37
finance.qq.comnginx/0.6.39
www.hotmail.comMicrosoft-IIS/6.0
www.jrj.com.cn
www.zhenai.comApache
business.sohu.comSWS
www.pcpop.comMicrosoft-IIS/6.0
www.stockstar.comnginx/0.7.59
www.tianya.cnMicrosoft-IIS/6.0
www.marry5.comApache
tieba.baidu.comapache 2.7.18.0
www.onlinedown.netMicrosoft-IIS/6.0
www.skycn.comApache
www.cmbchina.com
blog.sina.com.cnnginx/0.7.62
www.51.comApache
blog.163.comnginx
blog.sohu.comnginx
www.abchina.comMicrosoft-IIS/7.5,M2
www.ccb.comApache
sports.sina.com.cnApache
t.sina.com.cnApache
sports.sohu.comSWS
qzone.qq.comApache
sports.qq.comnginx/0.6.39
nba.tom.comnginx/0.6.32
sports.tom.comApache
tech.sina.com.cnApache
www.hoopchina.com[SA: xifan hcw/web-12-10-53　　程序和代码在这里