Re: [PROGRAMMING] Writing a spider
Have you looked into the heaton API package... I used it a while back when teaching Java Threads.
I'm not sure if you'll find them online but com.heaton.bot might fetch something. The library isn't the most elegant in semantics, but it's at least functional.