Thread: Pulling content from search engine results...
View Single Post
Old 02-14-2008, 03:05 PM   #10 (permalink)
nasty.web
v7n Mentor
 
Join Date: 07-24-06
Posts: 688
iTrader: 1 / 100%
Latest Blog:
None

nasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nicenasty.web is just really nice
You can try to imitate human behavior. Don't scrape to much at a time (think about user with few browser tabs open) and make a reasonable breaks between requests.
nasty.web is offline   Reply With Quote