[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
localCVS: www robots.txt
- To: localcvs at arabeyes dot org
- Subject: localCVS: www robots.txt
- From: Mohammed Elzubeir <elzubeir at arabeyes dot org>
- Date: Thu, 24 Jan 2002 12:50:13 -0600
------------------------------------------------------
From: elzubeir
Date: Thu Jan 24 12:50:12 CST 2002
Update of /home/LOCALCVS/www
In directory arabeyes.org:/home/elzubeir/devel/ae/www
Modified Files:
robots.txt
Log Message:
+ Diallowed fastweb crawler (excessive lameness, and no respect for robots.txt)