Dealing with bad robots

|

Mark once again has gone to great lengths to solve a problem and help others at the same time. This time he has tackled blocking bad robots. It's a great read.

In the comments I noticed that one person was complaining about Mark blocking GetRight. I had to block GetRight from the EFF Calendar because it was happily downloading calendar data for every possible date. The calendar is dynamically generated, so you can go almost as far back or forward in time as you want. It's limited by the date parsing in PHP. So the person wasn't just downloading this year, but every year, day, and week from 1969 to 2023. The calendar is the only thing I'm blocking from GetRight.

About this Entry

This page contains a single entry by Patrick published on February 26, 2003 1:30 PM.

Ideal Foreign Policy was the previous entry in this blog.

ready.gov spoofs is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

Powered by Movable Type 4.01