Hi;
I'm recieving so many hits from this fu*king spider. My site is turkish but this fu*king chinise spider is hitting me
Quote:
Agent: Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
It's ignoring robots.txt file . i have tried to block it with my robots.txt file and i have also tried to block it from cpanel.
But this bot continues to hit my server.
I need help to contact with this spider.
Thanks
http://forums.digitalpoint.com/showthread.php?t=368937#post3482529
这个可恶的搜索爬虫不断地读取我的数据,但我的网站可是土耳其文的啊——这只中文爬虫难道还懂土耳其文???!!!。
试过用robots.txt阻止其行动,但它压根就不理睬robots.txt文件,好像根本不懂似的。也试过从cpanel里阻挡它,但它还是不停地这样骚扰我。。。谁能邦邦我怎么联系这个爬虫的管理员。。。 ??


