M1 – Web Architecture in Website Communications
Search Engines
Web Spiders
Before search engines tell you where a file of document is, it has to be found. To find information on hundreds of millions of Web pages, a search engine used special software robots called spiders to build lists of the words found on websites. When the list is being built by spiders, it’s called Web crawling. To build and maintain a useful list of words, a search engine’s spiders have to go through a lot of sites. The process is quite simple. When a sequence of words is typed into a search engine such as ‘Suffolk One’, the spider looks at a HTML page and takes note of two things; The words within the page, and where the words are found. Words in the title, subtitle, meta tags and other positions are noted for special consideration during a search by a user. Most spiders are built to ignore significant words on pages such as ‘a’. ‘an’ and ‘the’. When the spider has built up an index of different pages, it builds a list of words and notes where they were found. It then builds an index of these websites by creating a system of weighting. The more times a series of words is mentioned on the website, such as ‘BBC’, the website will be higher. If a website is linked from the BBC, which will also feature higher in the search than if it was linked to a less known website. After the spider has created an index it encodes the data to a save space and stores data for users to access. Metatags

A metatag is a special HTML tag which provides information about a Webpage. Metatags don’t affect how the page looks, unlike normal HTML tags. Instead, they provide inf...

.. 2.0 24 24/7/365 365 7 abl access add advert affect afraid allow alreadi also amazon anyon applic architectur area around articl ask attract automat background bank base bbc becom benefit best better biggest bio blog blogger boolean bought build built buy call cannot card cds certain chang cheaper client close cloud code comment commerc commun communic complet comput connect consider content contribut control conveni cost country/world cover crawl creat creator credit custom data databas day deliv deliveri detail differ disabl document done door dvds e e-commerc e-read easier ebay either elder electron email encod encrypt encyclopedia engin entri exampl expertis facebook fals featur fewer file film final find follow format found game gateway generat get give go goe good guest hacker hassl header high higher hmv home hour hous html https hundr ignor import index inform instal instead internet isn isp issu item jessop keyword kill kindl know known layout less like link list live local look lot low m1 maintain make market may mean men mention merchant meta metatag million money much need network never new next normal note offlin often one onlin onto order overheads/costs page pay payment pc peopl phish photo pictur place play.com posit prevent price privaci privat process product profil program provid public put question quit re reader reassur recommend rememb remot rent repres result robot run save search secur see sell seller send sent sequenc seri server servic set shop show shown side signific similar simpl site size social softwar someth somewher space special spider staf status stock store straight street subtitl suffolk suit sure system tag take taken tell term text thing throughout tie time titl tool true tv tweet twitter two type ugc understand underwear unlik unwant updat use user usual valu want warehous way web webpag websit week weight went whenev wherev wiki wikipedia within without women won word work year