[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

localCVS: www robots.txt



------------------------------------------------------
From: elzubeir
Date: Thu Jan 24 12:50:12 CST 2002

Update of /home/LOCALCVS/www
In directory arabeyes.org:/home/elzubeir/devel/ae/www

Modified Files:
	robots.txt 

Log Message:
+ Diallowed fastweb crawler (excessive lameness, and no respect for robots.txt)