Guests

Post Reply
JJW009
Site Admin
Posts: 6538
Joined: Thu Jul 14, 2005 12:00 am
Location: Midlands
Contact:
Guests

Post by JJW009 »

I've been monitoring the strangely high number of guests we've been getting, and I think it's just search bots. They nearly all originate from the same IP range:



74.6.x.x



which traces back to Yahoo, who say this:


Why are you crawling my site?



Yahoo! Slurp is Yahoo!'s web-indexing robot. The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! search engine. These documents are discovered and crawled because other web pages contain links directing to these documents.


What amuses me is that they only ever see the index page, never the actual threads, and why on earth do they feel the need to do it 100 times a day!?



Also... Why doesn't Google do it? I sometimes wish they would - the search on this forum is powered by Google, and is total crap <!--emo&<_<--><img src='http://i2.ifrm.com/html/emoticons/dry.gif' border='0' style='vertical-align:middle' alt='dry.gif' /><!--endemo-->









That has been a geeky announcement. Thank you for flying with the silly fish.



<!--emo&:fish:--><img src='http://i2.ifrm.com/4013/140/emo/laughing-fish.gif' border='0' style='vertical-align:middle' alt='laughing-fish.gif' /><!--endemo-->




--------------------


<div class='signature'> <img src='http://myanimelist.net/signature/JJW009.png' border='0' alt='user posted image'> ??? <img src='http://imagegen.last.fm/LastfmMyspace/oartists/5/JJW009.gif' border='0' alt='user posted image'>
JJW009
Site Admin
Posts: 6538
Joined: Thu Jul 14, 2005 12:00 am
Location: Midlands
Contact:
Guests

Post by JJW009 »

<img src='http://i13.photobucket.com/albums/a254/JJW009/bots.png' border='0' alt='user posted image'>



Jeepers, what is it with them? How many times do they need to re-index the index page!?




--------------------


<div class='signature'> <img src='http://myanimelist.net/signature/JJW009.png' border='0' alt='user posted image'> ??? <img src='http://imagegen.last.fm/LastfmMyspace/oartists/5/JJW009.gif' border='0' alt='user posted image'>
brataccas
Posts: 608
Joined: Sun Jul 17, 2005 12:00 am
Guests

Post by brataccas »

spambots? <!--emo&:whistle:--><img src='http://i2.ifrm.com/4013/140/emo/eusa_whistle.gif' border='0' style='vertical-align:middle' alt='eusa_whistle.gif' /><!--endemo-->




--------------------


<div class='signature'> <img src='http://content.yieldmanager.edgesuite.n ... 94f81d.gif' border='0' alt='user posted image'>

<img src='http://i2.photobucket.com/albums/y1/bra ... n3copy.jpg' border='0' alt='user posted image'>



Q:Why do Saxons people call themselves British? A: because they are ashamed of being English??



Q: What does the GB sticker mean on the back of English cars? A: Germaniac Barbarian.
Big_Adam
Posts: 1635
Joined: Sat Jul 23, 2005 12:00 am
Location: Great Yarmouth
Guests

Post by Big_Adam »

Oh noes,



JJ has more powers than me.



Oh well their just spam bots. Their owner myst be killed.






--------------------


<div class='signature'> <img src='http://img.photobucket.com/albums/v630/ ... 722080.gif' border='0' alt='user posted image'>
JJW009
Site Admin
Posts: 6538
Joined: Thu Jul 14, 2005 12:00 am
Location: Midlands
Contact:
Guests

Post by JJW009 »

Not Spam bots, Search bots. They spider the web and index it so when you do a search, it can find stuff.



Google has never been here. Seriously. I did a Google search on the host I use, and it came back with 171,000 forums but not this one <!--emo&:(--><img src='http://i2.ifrm.com/html/emoticons/sad.gif' border='0' style='vertical-align:middle' alt='sad.gif' /><!--endemo-->



Yahoo! has indexed the same text-only version (of the index page only) nearly a million times. Here's a link:



Yahoo cache of the silly plaice




--------------------


<div class='signature'> <img src='http://myanimelist.net/signature/JJW009.png' border='0' alt='user posted image'> ??? <img src='http://imagegen.last.fm/LastfmMyspace/oartists/5/JJW009.gif' border='0' alt='user posted image'>
JJW009
Site Admin
Posts: 6538
Joined: Thu Jul 14, 2005 12:00 am
Location: Midlands
Contact:
Guests

Post by JJW009 »

Ooh - my random Googling found there's and entry for The_Wired on Wiki. For anyone who didn't already know why this forum is located at /The_Wired then have a read:



http://en.wikipedia.org/wiki/The_Wired



Anyone who has visited my house will know I'm nuts about SE Lain <!--emo&:unsure:--><img src='http://i2.ifrm.com/html/emoticons/unsure.gif' border='0' style='vertical-align:middle' alt='unsure.gif' /><!--endemo-->




--------------------


<div class='signature'> <img src='http://myanimelist.net/signature/JJW009.png' border='0' alt='user posted image'> ??? <img src='http://imagegen.last.fm/LastfmMyspace/oartists/5/JJW009.gif' border='0' alt='user posted image'>

Post Reply