11 November 2020

Good bot, bad bot. How search indexing works.

In 1993, Charlie Stross was feeling bored and fractious in his job at SCO UNIX. He decided to learn Perl and work on a Web spider since his company was...