Webmaster Forum


Go Back   Webmaster Forum > Web Development > Web Design Lobby
How to disallow user agent? How to disallow user agent?
Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

Web Design Lobby Forum for general web design issues not specific to scripting or graphics.

Easy Date   High Bandwidth Dedicated Servers   V7N Directory

Reply
 
LinkBack Thread Tools Display Modes
Old 12-20-2006, 05:38 PM   #1 (permalink)
v7n Mentor
 
Natural Elements's Avatar
 
Join Date: 08-15-06
Posts: 1,067
iTrader: 5 / 100%
Latest Blog:
None

Natural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of lightNatural Elements is a glorious beacon of light
How to disallow user agent?
Hello,

I've got on my stats many user-agents like User Agent: TMCrawler I don't want to let crawl my site, how I can do that on my robots.txt file?

Thanks
__________________
We are the premier tropical body care shop.
Tropical bath and body products - Hawaiian Bath Product Guide
Natural Elements is offline  
Add Post to del.icio.us
Reply With Quote
Sponsored Links
SEO Hosting by HostGator  Advertise Here  Buy Blog Links
Old 12-20-2006, 05:48 PM   #2 (permalink)
Contributing Member
 
Join Date: 07-08-06
Location: Here
Posts: 236
iTrader: 0 / 0%
Latest Blog:
None

daboss is a jewel in the roughdaboss is a jewel in the roughdaboss is a jewel in the roughdaboss is a jewel in the roughdaboss is a jewel in the roughdaboss is a jewel in the rough
best to use mod rewrite for this - .htaccess file...

check out:
http://fantomaster.com/faarticles/modrewrite01.txt
http://fantomaster.com/faarticles/modrewrite02.txt
http://fantomaster.com/faarticles/modrewrite03.txt
http://fantomaster.com/faarticles/modrewrite04.txt
daboss is offline  
Add Post to del.icio.us
Reply With Quote
Old 01-04-2007, 04:10 AM   #3 (permalink)
Inactive
 
Join Date: 01-04-07
Location: Bolton, UK
Posts: 59
iTrader: 0 / 0%
Latest Blog:
None

tinotriste is liked by many
Your just need to add this to your robots.txt file

User-agent: TMCrawler
Disallow: /
tinotriste is offline  
Add Post to del.icio.us
Reply With Quote
Old 02-07-2007, 07:25 AM   #4 (permalink)
Contributing Member
 
comforthost's Avatar
 
Join Date: 02-01-07
Posts: 144
iTrader: 0 / 0%
Latest Blog:
None

comforthost is liked by somebodycomforthost is liked by somebodycomforthost is liked by somebody
robots.txt is the best option. Although you can ban any specific host or ip using .htaccess
comforthost is offline  
Add Post to del.icio.us
Reply With Quote
Old 02-08-2007, 08:36 PM   #5 (permalink)
Inactive
 
Join Date: 10-02-06
Location: The Webernet
Posts: 142
iTrader: 0 / 0%
Latest Blog:
That?s All Folks

IndigoBlack is a jewel in the roughIndigoBlack is a jewel in the roughIndigoBlack is a jewel in the roughIndigoBlack is a jewel in the roughIndigoBlack is a jewel in the roughIndigoBlack is a jewel in the rough
Send a message via Yahoo to IndigoBlack
Hello,

Here is some information about banning a user agent using htaccess. You'll have to scroll to the bottom to get to your particular situation.

DevWebPro htaccess magic
IndigoBlack is offline  
Add Post to del.icio.us
Reply With Quote
Go Back   Webmaster Forum > Web Development > Web Design Lobby

Reply

« Previous Thread | Next Thread »


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
bzz agent marketing? jxb10 Marketing Forum 2 02-18-2008 04:43 PM


Sponsor Links
Get exposure! Get exposure! Find Scripts Web Hosting Directory Get exposure! SEO Blog


Site Navigation: v7n Home .::. Graphics .::. Scripts .::. Web Designers .::. SEO Consultants .::. Web Hosting

Partners:V7N Web Directory .::. V7N Technology Blog .::. Host Ratings@V7N .::. V7N Affiliate Program .::. Advertise

All times are GMT -7. The time now is 09:46 PM.
© Copyright 2008 V7 Inc

Contact Us - Internet Marketing - Top