Lately I’ve witnessed a couple of blatant attempts to rip content from our directory sites. Of course this pisses me off. It takes many months to build up a quality directory and to have this ripped and displayed by someone else as their site is frustrating. Anyway as a quick fix I’ve implemented a bot trap to catch and blacklist the buggers. It is loosely based on the script described in the article “How to build a Bot Trap and keep bad bots away from a web site”, only I’ve added some other detection methods and white listing so I don’t accidentally kill the good bots. “