Re: Simulating web traffic

[Lorenzo Hernandez Garcia-Hierro <lorenzohgh () tuxedo-es org>]

Hi Valdis,

El mié, 16-06-2004 a las 19:11, Valdis.Kletnieks () vt edu escribió:
> On Wed, 16 Jun 2004 15:37:44 +0200, Lorenzo Hernandez Garcia-Hierro said:
>
> > The best way to do what you wanted,in my opinion, is running a web
> > spider as a cron job or from the rc of each system user of the rest of
> > connected machines  ( when the user logs in the spider 

> is executed and
> > the time will not appear to be a strictly timed job).
>
> Note that without *heavy* modification, it will probably be quite easy to
> distinguish a spider from a "real" user.  Most spiders will stay connected for
> a long time, and end up visiting all the linked pages eventually.  On the other
> hand, users will come in - as many as 80% will probably already have a page
> bookmarked to go to, and the others will hit the home page, and then the vast
> majority will go to your "most popular" links.

I think in the same way as you, it's needed to write and modify a large
amount of code to cover the spider and put it appearing as a normal
user.

Anyway, we can set a small code to select randomly the link "spidering"
( of course , if you are not an internet adict you don't follow every
link in a page as its order :D ) and deep of the spidering.



> Looked at differently - if it's been at your site for 3 hours and is now
> looking at your press releases from 1998, it's either a spider, somebody
> conducting an info-gathering mission preparatory to industrial espionage or
> legal action, or somebody severely in need of a life.... ;)

;D Sure !

Cheers,
-- 
Lorenzo Hernandez Garcia-Hierro <lorenzohgh () tuxedo-es org>

Attachment: signature.asc
Description: Esta parte del mensaje está firmada digitalmente