Webmaster Forum - View Single Post - What directory does robots.txt need to be placed in?

MadHatter · 03-31-2004, 02:34 PM

I am pretty sure that if you specify them rules for 'media partners google' that google cannot crawl any of those pages (the *'s mean anything, like any post number)

03-31-2004, 02:34 PM	#6 (permalink)
MadHatter Inactive Join Date: 11-19-03 Posts: 496 iTrader: 0 / 0% Latest Blog: None	I am pretty sure that if you specify them rules for 'media partners google' that google cannot crawl any of those pages (the *'s mean anything, like any post number)