A spider is a robotic program that downloads web pages and looks at the code of the page. The spider doesn't have any visual components at all, if you right click on most web pages and go to view source that is what the spider can see.

While the spider is downloading pages, it is the crawler's job to strip apart the page and look for links. It is the crawler's job to look at the links and then decide where the spider should go next determined on the links or a pre-defined list of URL's.

It is the indexers job to analyse different aspects of a web page. It looks at Entities such as, titles, headings, links, text, constructs, bold, italic, and other style portions of a page that are ripped apart and analysed.

The database is where all the results and pages are stored, considering that there are an estimated 10 billion web pages on the Internet this can take a huge amount of storage space, which will be increasing indefinitely.

Search Engine Results Page:
The results page is where the clever stuff takes place; this is where the engine decides which page matches the query that was entered in the search box of their home page.

1 comment:

Anonymous said...

ludacrist move bitch
striper girls
wwe bikini contest strip
blonde teen girl photos
prostitute nz
bbw nudist
big tits small bra
sleazy babes
pittsburgh's strip districk
strip clubs peoria illinois

[URL=http://www.unlimlover.org/index.html]gay travel clubs[/URL]
[url=http://unlimlover.org/eva]teenie whores[/url]
[URL=http://www.unlimlover.com/gayparade/index.html]long haired man[/URL]
[url=http://unlimlover.org/showyou]asian gangs[/url]
[url=http://loverrules.com]hairy asian women[/url]
[URL=http://unlimlover.com/4/index.html]fat milfs[/URL]
[url=http://errozone.com/flirt]dove la stazione di latina[/url]
[url=http://unlimlover.org/jesebell]speed dating edmonton[/url]
[url=http://unlimlover.com/sindy]ludacris f mystikal move bitch[/url]
[url=http://unlimlover.net/erotique]bbw auto[/url]
[url=http://probe.unlimlover.com]marilyn monroe porn[/url]
[URL=http://unlimlover.com/5/index.html]tits blowjob[/URL]
[url=http://unlimlover.com/big]little girl orgasm[/url]
[url=http://unlimlover.net/lisa]sexey nudes[/url]
[URL=http://unlimlover.com/3/index.html]xxx housewives[/URL]