Webmaster Forum - View Single Post

I, Brian · 02-17-2004, 01:43 PM

Sessions IDs stop crawlers dead. The code takes out session IDs when the user-agent is Google or Inktomi, to allow them to continue crawling.

02-17-2004, 01:43 PM	#5 (permalink)
I, Brian Inactive Join Date: 10-26-03 Posts: 2,466 iTrader: 0 / 0% Latest Blog: None	Sessions IDs stop crawlers dead. The code takes out session IDs when the user-agent is Google or Inktomi, to allow them to continue crawling.