Alvin's Not So Smart Web-Trap

Alvin starts to realise his smart Web-Trap (using robot.txt) to block webcrawlers etc, stops his website being indexed and thus no one can find him, and the AI scrapers can just choose to ignore it.

So probably not such a great idea.