This guy Google [Bot} nevers posts

Talk about anything here.
Post Reply
User avatar
Smelters
Hall of Famer
Posts: 8289
Joined: Sun Jan 19, 2014 1:42 am

This guy Google [Bot} nevers posts

Post by Smelters »

z
User avatar
CleveTown™
Three-Time Fantasy Champion King
Posts: 71006
Joined: Sun Jan 19, 2014 6:31 am

Re: This guy Google [Bot} nevers posts

Post by CleveTown™ »

what a moron, it's a web crawler that collects data for internet searches.
October 16th, 2020. Thank you Pastor John (P)
January 7th. (D)
User avatar
TheStig
All-Star
Posts: 1584
Joined: Sat Jan 18, 2014 10:23 pm

Re: This guy Google [Bot} nevers posts

Post by TheStig »

LOL
User avatar
FPL
Hall of Famer
Posts: 8675
Joined: Sun Jan 12, 2014 11:18 pm

Re: This guy Google [Bot} nevers posts

Post by FPL »

Baidu Spider is on now. Hmmmm...
User avatar
swampgator
All-Time Great
Posts: 15566
Joined: Sat Jan 18, 2014 9:36 pm
Location: ATL

Re: This guy Google [Bot} nevers posts

Post by swampgator »

fpliii wrote:Baidu Spider is on now. Hmmmm...
There is no way to block these crawlers out?
User avatar
Smelters
Hall of Famer
Posts: 8289
Joined: Sun Jan 19, 2014 1:42 am

Re: This guy Google [Bot} nevers posts

Post by Smelters »

fpliii wrote:Baidu Spider is on now. Hmmmm...
Lol!!! at cleveclown getting all upset when I'm just joking. again right over his head.
User avatar
FPL
Hall of Famer
Posts: 8675
Joined: Sun Jan 12, 2014 11:18 pm

Re: This guy Google [Bot} nevers posts

Post by FPL »

swampgator wrote:
fpliii wrote:Baidu Spider is on now. Hmmmm...
There is no way to block these crawlers out?
Oh, I can, but there's no reason to do so, I'd say. They help get us traffic by moving us up in searches, caches pages, and some actually might give us visibility in ads.

They don't slow the site down, so there's no downside IMO.
User avatar
swampgator
All-Time Great
Posts: 15566
Joined: Sat Jan 18, 2014 9:36 pm
Location: ATL

Re: This guy Google [Bot} nevers posts

Post by swampgator »

fpliii wrote:
swampgator wrote:
fpliii wrote:Baidu Spider is on now. Hmmmm...
There is no way to block these crawlers out?
Oh, I can, but there's no reason to do so, I'd say. They help get us traffic by moving us up in searches, caches pages, and some actually might give us visibility in ads.

They don't slow the site down, so there's no downside IMO.
I see. Baidu is China's version of Google. How do you suppose that bot latched onto this site? I go through a proxy from a US server always when online.
User avatar
FPL
Hall of Famer
Posts: 8675
Joined: Sun Jan 12, 2014 11:18 pm

Re: This guy Google [Bot} nevers posts

Post by FPL »

swampgator wrote:
fpliii wrote:
swampgator wrote: There is no way to block these crawlers out?
Oh, I can, but there's no reason to do so, I'd say. They help get us traffic by moving us up in searches, caches pages, and some actually might give us visibility in ads.

They don't slow the site down, so there's no downside IMO.
I see. Baidu is China's version of Google. How do you suppose that bot latched onto this site? I go through a proxy from a US server always when online.
A bunch are built into phpbb (open source forum software we built this board with), and I've added a handful. Here's the current list:

"Manage bots
“Bots”, “spiders” or “crawlers” are automated agents most commonly used by search engines to update their databases. Since they rarely make proper use of sessions they can distort visitor counts, increase load and sometimes fail to index sites correctly. Here you can define a special type of user to overcome these problems.

BOT NAME LAST VISIT OPTIONS MARK
Google [Bot] Sat Feb 01, 2014 10:27 pm Deactivate Edit Delete
Baidu [Spider] Sat Feb 01, 2014 10:20 pm Deactivate Edit Delete
Google Feedfetcher Sat Feb 01, 2014 5:17 pm Deactivate Edit Delete
Google Adsense [Bot] Sat Feb 01, 2014 5:00 pm Deactivate Edit Delete
AdsBot [Google] Never Deactivate Edit Delete
Alexa [Bot] Never Deactivate Edit Delete
Alta Vista [Bot] Never Deactivate Edit Delete
Ask Jeeves [Bot] Never Deactivate Edit Delete
Bing [Bot] Never Deactivate Edit Delete
Exabot [Bot] Never Deactivate Edit Delete
FAST Enterprise [Crawler] Never Deactivate Edit Delete
FAST WebCrawler [Crawler] Never Deactivate Edit Delete
Francis [Bot] Never Deactivate Edit Delete
Gigabot [Bot] Never Deactivate Edit Delete
Google Desktop Never Deactivate Edit Delete
Heise IT-Markt [Crawler] Never Deactivate Edit Delete
Heritrix [Crawler] Never Deactivate Edit Delete
IBM Research [Bot] Never Deactivate Edit Delete
ICCrawler - ICjobs Never Deactivate Edit Delete
MSN NewsBlogs Never Deactivate Edit Delete
MSN [Bot] Never Deactivate Edit Delete
MSNbot Media Never Deactivate Edit Delete
Majestic-12 [Bot] Never Deactivate Edit Delete
Metager [Bot] Never Deactivate Edit Delete
Nutch [Bot] Never Deactivate Edit Delete
Omgili Never Deactivate Edit Delete
Online link [Validator] Never Deactivate Edit Delete
SEO Crawler Never Deactivate Edit Delete
SEOSearch [Crawler] Never Deactivate Edit Delete
Sensis [Crawler] Never Deactivate Edit Delete
Seoma [Crawler] Never Deactivate Edit Delete
Snappy [Bot] Never Deactivate Edit Delete
Steeler [Crawler] Never Deactivate Edit Delete
Telekom [Bot] Never Deactivate Edit Delete
TurnitinBot [Bot] Never Deactivate Edit Delete
Voyager [Bot] Never Deactivate Edit Delete
W3 [Sitesearch] Never Deactivate Edit Delete
W3C [Linkcheck] Never Deactivate Edit Delete
W3C [Validator] Never Deactivate Edit Delete
YaCy [Bot] Never Deactivate Edit Delete
Yahoo MMCrawler [Bot] Never Deactivate Edit Delete
Yahoo Slurp [Bot] Never Deactivate Edit Delete
Yahoo [Bot] Never Deactivate Edit Delete
YahooSeeker [Bot] Never Deactivate Edit Delete
ichiro [Crawler] Never Deactivate Edit Delete
psbot [Picsearch] Never Deactivate Edit Delete

Add bot"

Only four have visited for any meaningful duration so far, though a few others have been on for a short enough period of time that they haven't registered.

We can add some if you guys any will be useful. Here's a thread:

https://www.phpbb.com/community/viewtopic.php?t=935605" onclick="window.open(this.href);return false;
User avatar
ripper76
Accounts will be settled.
Posts: 29603
Joined: Sat Jan 18, 2014 4:59 pm

Re: This guy Google [Bot} nevers posts

Post by ripper76 »

We should form a resistance to win this war against the machines!
User avatar
Smelters
Hall of Famer
Posts: 8289
Joined: Sun Jan 19, 2014 1:42 am

Re: This guy Google [Bot} nevers posts

Post by Smelters »

ripper76 wrote:We should form a resistance to win this war against the machines!
Judgement day.
User avatar
ripper76
Accounts will be settled.
Posts: 29603
Joined: Sat Jan 18, 2014 4:59 pm

Re: This guy Google [Bot} nevers posts

Post by ripper76 »

Cobra Kai wrote:I am a malfunctioning bot
I think we already have at least one of those. I AM ERROR seems to be a defective bot as well.
Post Reply