This guy Google [Bot} nevers posts
- CleveTown™
- Three-Time Fantasy Champion King
- Posts: 71006
- Joined: Sun Jan 19, 2014 6:31 am
Re: This guy Google [Bot} nevers posts
what a moron, it's a web crawler that collects data for internet searches.
October 16th, 2020. Thank you Pastor John (P)
January 7th. (D)
January 7th. (D)
- swampgator
- All-Time Great
- Posts: 15566
- Joined: Sat Jan 18, 2014 9:36 pm
- Location: ATL
Re: This guy Google [Bot} nevers posts
There is no way to block these crawlers out?fpliii wrote:Baidu Spider is on now. Hmmmm...
Re: This guy Google [Bot} nevers posts
Lol!!! at cleveclown getting all upset when I'm just joking. again right over his head.fpliii wrote:Baidu Spider is on now. Hmmmm...
Re: This guy Google [Bot} nevers posts
Oh, I can, but there's no reason to do so, I'd say. They help get us traffic by moving us up in searches, caches pages, and some actually might give us visibility in ads.swampgator wrote:There is no way to block these crawlers out?fpliii wrote:Baidu Spider is on now. Hmmmm...
They don't slow the site down, so there's no downside IMO.
- swampgator
- All-Time Great
- Posts: 15566
- Joined: Sat Jan 18, 2014 9:36 pm
- Location: ATL
Re: This guy Google [Bot} nevers posts
I see. Baidu is China's version of Google. How do you suppose that bot latched onto this site? I go through a proxy from a US server always when online.fpliii wrote:Oh, I can, but there's no reason to do so, I'd say. They help get us traffic by moving us up in searches, caches pages, and some actually might give us visibility in ads.swampgator wrote:There is no way to block these crawlers out?fpliii wrote:Baidu Spider is on now. Hmmmm...
They don't slow the site down, so there's no downside IMO.
Re: This guy Google [Bot} nevers posts
A bunch are built into phpbb (open source forum software we built this board with), and I've added a handful. Here's the current list:swampgator wrote:I see. Baidu is China's version of Google. How do you suppose that bot latched onto this site? I go through a proxy from a US server always when online.fpliii wrote:Oh, I can, but there's no reason to do so, I'd say. They help get us traffic by moving us up in searches, caches pages, and some actually might give us visibility in ads.swampgator wrote: There is no way to block these crawlers out?
They don't slow the site down, so there's no downside IMO.
"Manage bots
“Bots”, “spiders” or “crawlers” are automated agents most commonly used by search engines to update their databases. Since they rarely make proper use of sessions they can distort visitor counts, increase load and sometimes fail to index sites correctly. Here you can define a special type of user to overcome these problems.
BOT NAME LAST VISIT OPTIONS MARK
Google [Bot] Sat Feb 01, 2014 10:27 pm Deactivate Edit Delete
Baidu [Spider] Sat Feb 01, 2014 10:20 pm Deactivate Edit Delete
Google Feedfetcher Sat Feb 01, 2014 5:17 pm Deactivate Edit Delete
Google Adsense [Bot] Sat Feb 01, 2014 5:00 pm Deactivate Edit Delete
AdsBot [Google] Never Deactivate Edit Delete
Alexa [Bot] Never Deactivate Edit Delete
Alta Vista [Bot] Never Deactivate Edit Delete
Ask Jeeves [Bot] Never Deactivate Edit Delete
Bing [Bot] Never Deactivate Edit Delete
Exabot [Bot] Never Deactivate Edit Delete
FAST Enterprise [Crawler] Never Deactivate Edit Delete
FAST WebCrawler [Crawler] Never Deactivate Edit Delete
Francis [Bot] Never Deactivate Edit Delete
Gigabot [Bot] Never Deactivate Edit Delete
Google Desktop Never Deactivate Edit Delete
Heise IT-Markt [Crawler] Never Deactivate Edit Delete
Heritrix [Crawler] Never Deactivate Edit Delete
IBM Research [Bot] Never Deactivate Edit Delete
ICCrawler - ICjobs Never Deactivate Edit Delete
MSN NewsBlogs Never Deactivate Edit Delete
MSN [Bot] Never Deactivate Edit Delete
MSNbot Media Never Deactivate Edit Delete
Majestic-12 [Bot] Never Deactivate Edit Delete
Metager [Bot] Never Deactivate Edit Delete
Nutch [Bot] Never Deactivate Edit Delete
Omgili Never Deactivate Edit Delete
Online link [Validator] Never Deactivate Edit Delete
SEO Crawler Never Deactivate Edit Delete
SEOSearch [Crawler] Never Deactivate Edit Delete
Sensis [Crawler] Never Deactivate Edit Delete
Seoma [Crawler] Never Deactivate Edit Delete
Snappy [Bot] Never Deactivate Edit Delete
Steeler [Crawler] Never Deactivate Edit Delete
Telekom [Bot] Never Deactivate Edit Delete
TurnitinBot [Bot] Never Deactivate Edit Delete
Voyager [Bot] Never Deactivate Edit Delete
W3 [Sitesearch] Never Deactivate Edit Delete
W3C [Linkcheck] Never Deactivate Edit Delete
W3C [Validator] Never Deactivate Edit Delete
YaCy [Bot] Never Deactivate Edit Delete
Yahoo MMCrawler [Bot] Never Deactivate Edit Delete
Yahoo Slurp [Bot] Never Deactivate Edit Delete
Yahoo [Bot] Never Deactivate Edit Delete
YahooSeeker [Bot] Never Deactivate Edit Delete
ichiro [Crawler] Never Deactivate Edit Delete
psbot [Picsearch] Never Deactivate Edit Delete
Add bot"
Only four have visited for any meaningful duration so far, though a few others have been on for a short enough period of time that they haven't registered.
We can add some if you guys any will be useful. Here's a thread:
https://www.phpbb.com/community/viewtopic.php?t=935605" onclick="window.open(this.href);return false;
Re: This guy Google [Bot} nevers posts
We should form a resistance to win this war against the machines!
Re: This guy Google [Bot} nevers posts
Judgement day.ripper76 wrote:We should form a resistance to win this war against the machines!
Re: This guy Google [Bot} nevers posts
I think we already have at least one of those. I AM ERROR seems to be a defective bot as well.Cobra Kai wrote:I am a malfunctioning bot