Webmaster Forum

Go Back   Webmaster Forum > V7N Webmaster Marketplace > The Webmaster Marketplace > Content

Content Buy and sell scripts, prewritten articles and databases for your website or blog here.


Reply
 
Thread Tools Display Modes
Share |
  #1  
Old 02-26-2013, 08:35 AM
myip.ms myip.ms is offline
Junior Member
 
Join Date: 02-25-13
Posts: 2
iTrader: 0 / 0%
Lightbulb Analytics - BLACKLIST IP Addresses Live Database (Real-time, 25,000+ ip) spam bots...

.
Analytics - BLACKLIST IP Addresses Live Database (Real-time, 25,000+ ip) - spam bots, unknown bots, etc.

At this time on the internet many unknown bot/spiders are masking as normal users. We have found an easy way to identify them. Our company have created a real time blacklist of IP addresses based on statistics held on the large websites which we operate.
This blacklist database was run nearly 6 months ago and at this moment nearly 25,000 + ipís are contained in this list. It includes: Unknown Spam Bots masking as a normal users and also Majestic12 bots, Proximic bots, 80legs bots, Ahrefs bots, etc.
It works full in automatic mode and updates itself every hour. Also our own users have added various ip addresses to that blacklist. Please see in attachment fresh text file with blacklist ip.

According to our internal file download statistics at this moment our free IP Blacklist List in text file automatically downloads data on 500 companies/hosting providers every day from our website..
The top three user countries which have download our blacklist: USA/Germany/Israel.

Our unique protection system allow easy identification of the real visitors ip with any bots/crawlers ip addresses and other threats include unknown crawlers/bots masking themselves as normal users.

The operating principle of our protection system is very simple: We allow any user to browse 10 pages on any of our websites, and after system start to display free registration form on the website and to block all pages on website (i.e. visitor will see only free registration form on all pages). We ask visitors to freely register on site themselves or to revisit us after to 24 hours to browse other pages.

Crawlers/Bots ignore such instructions and they would try to continue crawling the website. Normal users can click links on the website also but he/she will see all the time registered page and after they have seen 10-20 pages they will stop. But Bots would continue crawler on the website even despite those displays. We count the use of the site. And after 100 requests to see different site pages with registration form and every time is displayed a registration form we can be 100% sure the visitor is a BOT, even if it is masking itself as a normal user.

If user agent line has no any identification of that bot and is masking itself as a normal user we will automatically add its IP to our blacklist. For example Google Bot have user agent:
Mozilla/5.0 (compatible; Googlebot/2.1; ...........) and not hide it.

Therefore our Blacklist of IPs addresses consists only of unknown crawlers/spam bots masking themselves as normal users and our Blacklist has no search crawlers like Google Bot, Yahoo Bot, Bing Bot and others which nobody has tried to mask as a normal real user.

We have not found on the internet a service of similar kind which creates a IP Addresses Blacklist of unknown dangerous crawlers / spam bots in real time so we hope you will found ours useful.

Blacklist IP addresses text file (25,000 ip, 26 February 2013) attached.

.
Attached Files
File Type: zip myip.ms-blacklist.zip (339.9 KB, 13 views)
 
Reply With Quote

Advertisement

Advertisement

Go Back   Webmaster Forum > V7N Webmaster Marketplace > The Webmaster Marketplace > Content

Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Facebook Introduces Real-Time Analytics for Pages snakeair Social Network Marketing 1 06-14-2012 07:53 AM
Google Analytics now brings Real-time Stats xubair Google Forum 6 10-03-2011 12:58 AM
Piwik - open source real time web analytics software HTMLBasicTutor SEO Forum 0 02-25-2011 02:46 AM
Real unique visitors guaranteed USA - No Spam No Bots AcrowHost Sell Web Services 0 01-14-2011 09:38 AM


V7N Network
Get exposure! V7N I Love Photography V7N SEO Blog V7N Directory


All times are GMT -7. The time now is 01:15 AM.
Powered by vBulletin
Copyright © 2000-2014 Jelsoft Enterprises Limited.
Copyright © 2003 - 2018 VIX-WomensForum LLC